Jul 22 16:21:03.150194 ip-10-0-143-30 systemd[1]: Starting Kubernetes Kubelet... Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.458428 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462922 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462934 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462937 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462942 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462945 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462949 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462952 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:21:03.499150 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462955 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462957 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462960 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462963 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462965 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462968 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462971 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462975 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462979 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462982 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462985 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462988 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462991 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462993 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462996 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.462999 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463001 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463004 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463007 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:21:03.500041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463009 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463012 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463015 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463018 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463020 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463023 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463026 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463028 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463031 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463033 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463036 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463038 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463041 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463044 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463047 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463049 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463053 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463055 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463058 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463060 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463063 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:21:03.500563 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463065 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463068 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463070 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463073 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463075 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463077 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463080 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463082 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463085 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463088 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463091 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463093 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463096 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463099 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463102 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463105 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463108 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463111 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463113 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463116 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:21:03.501512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463118 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463120 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463123 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463127 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463131 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463134 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463138 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463141 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463143 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463146 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463148 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463151 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463154 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463157 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463160 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463162 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463165 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463167 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463170 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:21:03.502790 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463172 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463175 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463178 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463180 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463183 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463187 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463190 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463194 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463197 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463200 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463203 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463206 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463209 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463928 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463936 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463939 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463941 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463944 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463948 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:21:03.504574 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463951 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463955 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463958 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463961 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463964 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463967 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463970 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463972 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463975 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463977 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463980 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463982 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463985 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463987 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463990 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463993 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463995 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.463998 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464001 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464006 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:21:03.506503 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464010 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464013 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464017 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464021 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464024 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464027 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464030 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464033 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464035 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464037 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464040 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464043 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464046 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464049 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464051 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464054 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464056 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464059 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464061 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464064 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:21:03.510644 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464066 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464069 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464072 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464074 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464077 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464079 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464082 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464085 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464087 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464089 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464092 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464095 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464098 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464101 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464104 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464106 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464109 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464111 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464114 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464116 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:21:03.513312 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464118 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464121 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464123 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464126 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464129 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464132 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464136 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464140 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464143 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464146 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464149 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464152 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464155 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464158 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464161 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464163 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464166 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464168 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464171 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:21:03.516491 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464173 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464176 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464178 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464181 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464185 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464188 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464190 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464193 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464195 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464198 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464200 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464203 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464205 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464208 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464570 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464575 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464578 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464580 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464583 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:21:03.517158 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464586 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464589 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464592 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464594 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464597 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464600 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464602 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464605 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464608 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464610 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464613 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464615 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464618 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464620 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464623 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464625 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464628 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464632 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464635 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:21:03.520068 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464638 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464640 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464643 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464646 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464648 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464650 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464653 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464656 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464658 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464661 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464664 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464666 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464669 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464672 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464675 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464677 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464679 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464682 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464684 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464687 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:21:03.520688 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464689 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464692 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464695 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464697 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464699 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464703 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464706 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464708 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464711 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464713 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464718 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464720 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464723 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464725 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464728 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464730 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464733 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464735 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464738 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464740 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:21:03.522702 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464743 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464745 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464748 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464752 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464754 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464757 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464760 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464763 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464765 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464768 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464771 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464775 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464778 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464780 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464783 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464785 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464788 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464790 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464795 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:21:03.523448 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464798 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464801 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464804 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464808 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464810 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464814 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464817 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464820 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464823 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464826 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464829 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464857 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464860 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464863 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464866 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.464868 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464939 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464946 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464953 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464957 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 16:21:03.524226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464962 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464965 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464969 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464976 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464979 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464982 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464986 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464989 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464992 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464995 2574 flags.go:64] FLAG: --cgroup-root="" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.464998 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465001 2574 flags.go:64] FLAG: --client-ca-file="" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465004 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465007 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465012 2574 flags.go:64] FLAG: --cluster-domain="" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465016 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465019 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465022 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465026 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465029 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465032 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465036 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465039 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465042 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 22 16:21:03.524783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465044 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465048 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465051 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465054 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465060 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465064 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465067 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465069 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465072 2574 flags.go:64] FLAG: --enable-server="true" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465076 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465080 2574 flags.go:64] FLAG: --event-burst="100" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465084 2574 flags.go:64] FLAG: --event-qps="50" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465086 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465090 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465092 2574 flags.go:64] FLAG: --eviction-hard="" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465096 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465099 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465102 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465105 2574 flags.go:64] FLAG: --eviction-soft="" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465108 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465111 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465114 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465116 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465121 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465123 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 16:21:03.525590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465127 2574 flags.go:64] FLAG: --feature-gates="" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465130 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465133 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465136 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465139 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465142 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465145 2574 flags.go:64] FLAG: --help="false" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465148 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-143-30.ec2.internal" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465151 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465154 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465156 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465161 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465164 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465167 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465170 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465173 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465175 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465179 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465182 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465185 2574 flags.go:64] FLAG: --kube-reserved="" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465188 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465190 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465193 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465196 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 16:21:03.526293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465199 2574 flags.go:64] FLAG: --lock-file="" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465201 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465204 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465207 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465212 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465215 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465219 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465222 2574 flags.go:64] FLAG: --logging-format="text" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465225 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465229 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465231 2574 flags.go:64] FLAG: --manifest-url="" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465234 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465238 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465241 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465245 2574 flags.go:64] FLAG: --max-pods="110" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465248 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465251 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465254 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465257 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465261 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465264 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465267 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465274 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465277 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465280 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 16:21:03.626941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465283 2574 flags.go:64] FLAG: --pod-cidr="" Jul 22 16:21:03.530922 ip-10-0-143-30 systemd[1]: Started Kubernetes Kubelet. Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465287 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465292 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465295 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465298 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465301 2574 flags.go:64] FLAG: --port="10250" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465304 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465307 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a1f10771e6c8027f" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465310 2574 flags.go:64] FLAG: --qos-reserved="" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465313 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465316 2574 flags.go:64] FLAG: --register-node="true" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465319 2574 flags.go:64] FLAG: --register-with-taints="" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465323 2574 flags.go:64] FLAG: --registry-burst="10" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465326 2574 flags.go:64] FLAG: --registry-qps="5" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465329 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465332 2574 flags.go:64] FLAG: --reserved-memory="" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465336 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465339 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465342 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465345 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465347 2574 flags.go:64] FLAG: --runonce="false" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465350 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465353 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465356 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465359 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 16:21:03.628223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465362 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465365 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465369 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465372 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465375 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465378 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465381 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465383 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465386 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465389 2574 flags.go:64] FLAG: --system-cgroups="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465392 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465398 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465400 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465403 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465408 2574 flags.go:64] FLAG: --tls-min-version="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465411 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465413 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465416 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465419 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465422 2574 flags.go:64] FLAG: --v="2" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465427 2574 flags.go:64] FLAG: --version="false" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465431 2574 flags.go:64] FLAG: --vmodule="" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465434 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.465437 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465552 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:21:03.632330 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465555 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465559 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465562 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465565 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465567 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465570 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465572 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465575 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465578 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465582 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465584 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465587 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465590 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465592 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465595 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465597 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465600 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465610 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465613 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465616 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:21:03.633437 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465618 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465621 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465624 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465626 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465629 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465631 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465633 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465638 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465641 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465643 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465646 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465648 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465651 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465654 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465656 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465661 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465664 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465667 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465670 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:21:03.636511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465674 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465677 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465681 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465684 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465687 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465689 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465692 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465694 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465697 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465700 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465702 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465706 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465708 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465711 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465713 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465716 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465719 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465721 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465724 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465728 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:21:03.637257 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465733 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465736 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465739 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465742 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465744 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465747 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465750 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465753 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465756 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465758 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465761 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465764 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465767 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465769 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465773 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465776 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465779 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465781 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465784 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:21:03.640278 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465786 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465789 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465791 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465794 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465796 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465799 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465802 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465804 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465807 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465809 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465812 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465814 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465817 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465821 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465824 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465826 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465829 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465844 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465847 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:21:03.641041 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.465850 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.466970 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.473355 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.473371 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.473391 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.473398 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473453 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473458 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473461 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473464 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473467 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473470 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473473 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473476 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:21:03.644828 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473479 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473482 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473485 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473488 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473494 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473497 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473500 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473502 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473506 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473510 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473513 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473517 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473520 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473523 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473526 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473529 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473531 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473534 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:21:03.645587 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473537 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473539 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473542 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473545 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473548 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473550 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473553 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473556 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473558 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473561 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473563 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473566 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473568 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473571 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473573 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473576 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473578 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473581 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473585 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473587 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:21:03.650210 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473591 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473594 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473596 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473599 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473601 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473604 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473607 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473609 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473612 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473614 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473617 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473619 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473622 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473625 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473627 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473630 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473633 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473635 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473638 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473640 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:21:03.650972 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473643 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473645 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473648 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473650 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473654 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473658 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473662 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473665 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473667 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473670 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473673 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473676 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473680 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473683 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473686 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473688 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473691 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473693 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473695 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473698 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:21:03.651735 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473700 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473703 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473706 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473708 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473711 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473713 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473716 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473718 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473721 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473724 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473726 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473729 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473731 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.473736 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473870 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 16:21:03.748766 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473876 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473879 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473882 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473885 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473888 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473891 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473894 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473896 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473901 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473908 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473911 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473916 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473919 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473921 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473924 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473926 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473929 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473931 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473934 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 16:21:03.749417 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473937 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473939 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473942 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473945 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473947 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473949 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473952 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473955 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473957 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473960 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473962 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473964 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473967 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473969 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473972 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473974 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473976 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473979 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473982 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 16:21:03.750178 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473984 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473988 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473991 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473994 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473996 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.473999 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474002 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474004 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474007 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474009 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474012 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474014 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474017 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474020 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474022 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474025 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474027 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474030 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474034 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474037 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 16:21:03.752511 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474040 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474044 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474046 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474049 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474051 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474055 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474059 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474061 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474064 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474067 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474070 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474072 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474074 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474078 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474082 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474084 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474087 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474089 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474092 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 16:21:03.753288 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474096 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474099 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474102 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474105 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474107 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474110 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474113 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474116 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474118 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474121 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474123 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474126 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474128 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474131 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474133 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474136 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474139 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474141 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474144 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 16:21:03.756358 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:03.474146 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.474151 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.474261 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.476619 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.477693 2574 server.go:1019] "Starting client certificate rotation" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.477793 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.478469 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.479798 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.483729 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.493460 2574 log.go:25] "Validated CRI v1 runtime API" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.497341 2574 log.go:25] "Validated CRI v1 image API" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.498251 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 16:21:03.757152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.501500 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c94179f1-5e76-4d3a-b73f-07d0589d0209:/dev/nvme0n1p3 e17add89-cbcf-40d7-a2ed-ed73a84d7839:/dev/nvme0n1p4] Jul 22 16:21:03.854508 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.501521 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.507197 2574 manager.go:216] Machine: {Timestamp:2026-07-22 16:21:03.505441286 +0000 UTC m=+0.258377426 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100345 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29e6ed9b396aab5241c54cd60f402f SystemUUID:ec29e6ed-9b39-6aab-5241-c54cd60f402f BootID:703e30b5-18f1-440d-9580-d482f46c0c91 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:f6:36:c0:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:f6:36:c0:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:aa:b7:c8:73:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.507316 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.507389 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.509265 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.509289 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.509871 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.509887 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 16:21:03.854896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.509898 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.509913 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.511022 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514641 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514753 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514785 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514795 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514811 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514820 2574 kubelet.go:398] "Adding apiserver pod source" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.514830 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.515215 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.515235 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.522702 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.522750 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.524741 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.524785 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525759 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525773 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525779 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525784 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525793 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525799 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525809 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525815 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525822 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525827 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525862 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.525868 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.526400 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.526410 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.529993 2574 server.go:1268] "Started kubelet" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.530026 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.530065 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.530145 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.530475 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.530523 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.530588 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.532699 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.534239 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 16:21:03.863306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.540534 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.540893 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.541577 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vk82q" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.541681 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.541799 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.542299 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.542315 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.542742 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.542751 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.542918 2574 factory.go:55] Registering systemd factory Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.542934 2574 factory.go:223] Registration of the systemd container factory successfully Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.541133 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-30.ec2.internal.18c4a915d217b72c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-30.ec2.internal,UID:ip-10-0-143-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-30.ec2.internal,},FirstTimestamp:2026-07-22 16:21:03.52973598 +0000 UTC m=+0.282672121,LastTimestamp:2026-07-22 16:21:03.52973598 +0000 UTC m=+0.282672121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-30.ec2.internal,}" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.545328 2574 factory.go:153] Registering CRI-O factory Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.545345 2574 factory.go:223] Registration of the crio container factory successfully Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.545443 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.545504 2574 factory.go:103] Registering Raw factory Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.545520 2574 manager.go:1196] Started watching for new ooms in manager Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.545934 2574 manager.go:349] Starting recovery of all containers Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.546082 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.547329 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.547421 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.554639 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vk82q" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.559990 2574 manager.go:354] Recovery completed Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.566296 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568245 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568280 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568339 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568899 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568915 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568922 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.568934 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.569665 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:03.865034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.569699 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.569710 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.570388 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-30.ec2.internal.18c4a915d46390e6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-30.ec2.internal,UID:ip-10-0-143-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-30.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-30.ec2.internal,},FirstTimestamp:2026-07-22 16:21:03.56826135 +0000 UTC m=+0.321197492,LastTimestamp:2026-07-22 16:21:03.56826135 +0000 UTC m=+0.321197492,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-30.ec2.internal,}" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.571026 2574 policy_none.go:49] "None policy: Start" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.571038 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.571049 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.573022 2574 policy_none.go:47] "Start" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.603448 2574 manager.go:337] "Starting Device Plugin manager" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.603483 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.603492 2574 server.go:87] "Starting device plugin registration server" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.603783 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.603796 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.603946 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.604055 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.604064 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.604457 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.604500 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.704530 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.705601 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.705633 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.705647 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.705673 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-30.ec2.internal" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:03.717044 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-30.ec2.internal" Jul 22 16:21:03.866294 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.717064 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-30.ec2.internal\": node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:03.987119 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:03.986878 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:04.089823 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.089766 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:04.096033 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.095996 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 16:21:04.097469 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.097451 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 16:21:04.097536 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.097497 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 16:21:04.097536 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.097524 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 16:21:04.097614 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.097568 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 16:21:04.100161 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.100140 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:04.192888 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.192818 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:04.198402 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.198381 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal"] Jul 22 16:21:04.198463 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.198454 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:04.199538 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.199519 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:04.199652 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.199557 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:04.199652 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.199572 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:04.202233 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.202217 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:04.202346 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.202329 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.202409 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.202370 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:04.203063 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.203043 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:04.203163 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.203081 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:04.203163 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.203092 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:04.203163 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.203047 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:04.203163 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.203152 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:04.203163 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.203164 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:04.205697 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.205680 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.205750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.205716 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 16:21:04.206409 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.206390 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientMemory" Jul 22 16:21:04.206479 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.206425 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 16:21:04.206479 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.206442 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeHasSufficientPID" Jul 22 16:21:04.230670 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.230643 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-30.ec2.internal\" not found" node="ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.235410 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.235390 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-30.ec2.internal\" not found" node="ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.246232 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.246215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68ef05445162f1383037c1357bbb8630-config\") pod \"kube-apiserver-proxy-ip-10-0-143-30.ec2.internal\" (UID: \"68ef05445162f1383037c1357bbb8630\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.246304 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.246240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33bdd73f41c9a28bcba61f6b3daf713b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"33bdd73f41c9a28bcba61f6b3daf713b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.246304 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.246259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33bdd73f41c9a28bcba61f6b3daf713b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"33bdd73f41c9a28bcba61f6b3daf713b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.293273 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.293238 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-30.ec2.internal\" not found" Jul 22 16:21:04.347471 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.347393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33bdd73f41c9a28bcba61f6b3daf713b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"33bdd73f41c9a28bcba61f6b3daf713b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.347471 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.347442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33bdd73f41c9a28bcba61f6b3daf713b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"33bdd73f41c9a28bcba61f6b3daf713b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.347598 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.347497 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33bdd73f41c9a28bcba61f6b3daf713b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"33bdd73f41c9a28bcba61f6b3daf713b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.347598 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.347484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68ef05445162f1383037c1357bbb8630-config\") pod \"kube-apiserver-proxy-ip-10-0-143-30.ec2.internal\" (UID: \"68ef05445162f1383037c1357bbb8630\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.347598 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.347559 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68ef05445162f1383037c1357bbb8630-config\") pod \"kube-apiserver-proxy-ip-10-0-143-30.ec2.internal\" (UID: \"68ef05445162f1383037c1357bbb8630\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.347598 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.347569 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33bdd73f41c9a28bcba61f6b3daf713b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal\" (UID: \"33bdd73f41c9a28bcba61f6b3daf713b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.353154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.353131 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:04.444970 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.444935 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.453674 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.453654 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:04.458164 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.458139 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 16:21:04.459906 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.459892 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.470119 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.470101 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 16:21:04.477830 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.477811 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 16:21:04.477961 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.477944 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 16:21:04.478011 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.477988 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 16:21:04.478048 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.477993 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 16:21:04.516098 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.516069 2574 apiserver.go:52] "Watching apiserver" Jul 22 16:21:04.533701 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.533675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.535582 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.535561 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 16:21:04.535970 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.535948 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-4tpzx","openshift-network-operator/iptables-alerter-fl8xz","openshift-ovn-kubernetes/ovnkube-node-5xjz6","kube-system/konnectivity-agent-dxzrj","kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4rfn8","openshift-dns/node-resolver-5w78n","openshift-image-registry/node-ca-9vrh9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal","openshift-multus/multus-additional-cni-plugins-qbk5v","openshift-multus/multus-phszj","kube-system/global-pull-secret-syncer-5qd2x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q","openshift-multus/network-metrics-daemon-72lmt"] Jul 22 16:21:04.538094 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.538068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" Jul 22 16:21:04.539826 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.539093 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.541232 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.541214 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 16:21:04.541564 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.541543 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wz42t\"" Jul 22 16:21:04.541721 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.541702 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phszj" Jul 22 16:21:04.541870 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.541837 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.542104 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.541996 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.544886 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.544509 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 16:21:04.544886 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.544800 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 16:21:04.545055 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.545008 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.545755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.545731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5kfv\"" Jul 22 16:21:04.545878 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.545817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.546023 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.545740 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.547369 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.547345 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.548191 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548164 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 16:21:04.548541 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548521 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.548541 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbcf5672-85e2-4811-99f3-fc26314acb03-cni-binary-copy\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-hostroot\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548578 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-var-lib-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-log-socket\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-ovnkube-config\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-system-cni-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-socket-dir-parent\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548712 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-k8s-cni-cncf-io\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-multus-certs\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-env-overrides\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz95m\" (UniqueName: \"kubernetes.io/projected/4043d803-9ff8-4532-b372-4d51b2c189df-kube-api-access-rz95m\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-cni-bin\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-conf-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-daemon-config\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-etc-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-run-ovn-kubernetes\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-hosts-file\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.548987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-ovn\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.548987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4043d803-9ff8-4532-b372-4d51b2c189df-ovn-node-metrics-cert\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2kgd\" (UniqueName: \"kubernetes.io/projected/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-kube-api-access-z2kgd\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-os-release\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8x52\" (UniqueName: \"kubernetes.io/projected/bbcf5672-85e2-4811-99f3-fc26314acb03-kube-api-access-s8x52\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-systemd-units\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-slash\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-cni-bin\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-tmp-dir\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-cni-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-node-log\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-cni-netd\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.549470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-ovnkube-script-lib\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-cnibin\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-netns\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-cni-multus\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-kubelet\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-kubelet\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-etc-kubernetes\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-run-netns\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-systemd\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549730 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549747 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6rhk\"" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.549795 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.550069 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.550091 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.550161 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.550173 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:04.550272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.550253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s8td2\"" Jul 22 16:21:04.550838 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.550335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 16:21:04.552389 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.552371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.554410 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.554393 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 16:21:04.554665 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.554647 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.554795 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.554705 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rgdbb\"" Jul 22 16:21:04.554795 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.554647 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.555002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.554987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.557266 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.557249 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltrq5\"" Jul 22 16:21:04.557389 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.557360 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 16:21:04.557389 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.557383 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.557543 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.557466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.557543 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.557502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.559255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.559218 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 16:16:04 +0000 UTC" deadline="2028-04-24 14:38:11.932259338 +0000 UTC" Jul 22 16:21:04.559255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.559253 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15406h17m7.373008295s" Jul 22 16:21:04.559886 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.559869 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 16:21:04.559967 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.559953 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.560017 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.559970 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.560216 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.560197 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.560600 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.560585 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-whb5w\"" Jul 22 16:21:04.562262 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.562249 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 16:21:04.562539 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.562522 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:21:04.562600 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.562570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.562644 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.562631 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 16:21:04.562690 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.562647 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7qlp\"" Jul 22 16:21:04.566651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.566186 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 16:21:04.566651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.566440 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 16:21:04.566651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.566504 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f46vz\"" Jul 22 16:21:04.566651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.566625 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:04.566844 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.566704 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:04.569020 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.569000 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.569105 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.569059 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:04.575904 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.575883 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-28s2s" Jul 22 16:21:04.585549 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.585528 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-28s2s" Jul 22 16:21:04.643065 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.643045 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 16:21:04.650167 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-netns\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-cni-multus\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95140c89-1077-4a8c-be4c-4a72f2b3784a-host\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.650255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-registration-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.650366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-cni-multus\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650264 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-netns\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-tuned\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.650366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:04.650366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-kubelet\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-systemd\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-socket-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650431 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-kubelet\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-systemd\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysconfig\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbcf5672-85e2-4811-99f3-fc26314acb03-cni-binary-copy\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-log-socket\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96ac3a20-6e4d-4f3a-bed1-37320630118b-kubelet-config\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.650620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-system-cni-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650640 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-log-socket\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-socket-dir-parent\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650685 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-system-cni-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d3572e8-4046-49f3-bd59-eb7fa08defba-agent-certs\") pod \"konnectivity-agent-dxzrj\" (UID: \"5d3572e8-4046-49f3-bd59-eb7fa08defba\") " pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysctl-conf\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-var-lib-kubelet\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqdp6\" (UniqueName: \"kubernetes.io/projected/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-kube-api-access-zqdp6\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650797 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-socket-dir-parent\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-cni-bin\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650826 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-var-lib-cni-bin\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-conf-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-run-ovn-kubernetes\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650930 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-conf-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650942 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-run-ovn-kubernetes\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.650980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjfw\" (UniqueName: \"kubernetes.io/projected/61dc5eac-5eb0-4285-8558-b077073bb35a-kube-api-access-ldjfw\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-sys-fs\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-cnibin\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651072 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbcf5672-85e2-4811-99f3-fc26314acb03-cni-binary-copy\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4043d803-9ff8-4532-b372-4d51b2c189df-ovn-node-metrics-cert\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651138 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh9bl\" (UniqueName: \"kubernetes.io/projected/95140c89-1077-4a8c-be4c-4a72f2b3784a-kube-api-access-nh9bl\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-system-cni-dir\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.651730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d3572e8-4046-49f3-bd59-eb7fa08defba-konnectivity-ca\") pod \"konnectivity-agent-dxzrj\" (UID: \"5d3572e8-4046-49f3-bd59-eb7fa08defba\") " pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-slash\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-tmp-dir\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-sys\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651395 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-slash\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651409 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-kubernetes\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6hbq\" (UniqueName: \"kubernetes.io/projected/e21a90a5-7d55-49c6-9576-21ce020c4443-kube-api-access-b6hbq\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651460 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-cnibin\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-kubelet\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-systemd\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-etc-kubernetes\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651544 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-kubelet\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.652373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-run-netns\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95140c89-1077-4a8c-be4c-4a72f2b3784a-serviceca\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651575 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-cnibin\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651591 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-etc-kubernetes\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651618 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-run-netns\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651659 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-tmp-dir\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e21a90a5-7d55-49c6-9576-21ce020c4443-host-slash\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-hostroot\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651737 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-hostroot\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-var-lib-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-ovnkube-config\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-run\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-var-lib-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-k8s-cni-cncf-io\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651876 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-k8s-cni-cncf-io\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-multus-certs\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-env-overrides\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz95m\" (UniqueName: \"kubernetes.io/projected/4043d803-9ff8-4532-b372-4d51b2c189df-kube-api-access-rz95m\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.651990 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-host-run-multus-certs\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-host\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-daemon-config\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-etc-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-hosts-file\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-tmp\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-ovn\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652239 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-hosts-file\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2kgd\" (UniqueName: \"kubernetes.io/projected/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-kube-api-access-z2kgd\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xsbf\" (UniqueName: \"kubernetes.io/projected/5e1b6142-c64c-4156-b166-ed7659b4df6c-kube-api-access-2xsbf\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.653527 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652340 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-etc-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652325 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-env-overrides\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqccj\" (UniqueName: \"kubernetes.io/projected/c5d2d768-868c-4da9-b944-d78aa18eda4e-kube-api-access-mqccj\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652381 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-ovn\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96ac3a20-6e4d-4f3a-bed1-37320630118b-dbus\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-os-release\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-ovnkube-config\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8x52\" (UniqueName: \"kubernetes.io/projected/bbcf5672-85e2-4811-99f3-fc26314acb03-kube-api-access-s8x52\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-systemd-units\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-os-release\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652545 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-run-openvswitch\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-cni-bin\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-device-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.653992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652604 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-cni-bin\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-os-release\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652585 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-systemd-units\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysctl-d\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-cni-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652675 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-daemon-config\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-node-log\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-cni-netd\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652725 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-node-log\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-ovnkube-script-lib\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652751 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4043d803-9ff8-4532-b372-4d51b2c189df-host-cni-netd\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652792 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbcf5672-85e2-4811-99f3-fc26314acb03-multus-cni-dir\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-modprobe-d\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.654504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-lib-modules\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.654993 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.652903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e21a90a5-7d55-49c6-9576-21ce020c4443-iptables-alerter-script\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.654993 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.653186 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4043d803-9ff8-4532-b372-4d51b2c189df-ovnkube-script-lib\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.654993 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.654728 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4043d803-9ff8-4532-b372-4d51b2c189df-ovn-node-metrics-cert\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.661633 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.661610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2kgd\" (UniqueName: \"kubernetes.io/projected/07b9e9f0-f2c0-4700-bf95-ab445d7d3830-kube-api-access-z2kgd\") pod \"node-resolver-5w78n\" (UID: \"07b9e9f0-f2c0-4700-bf95-ab445d7d3830\") " pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.661633 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.661609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz95m\" (UniqueName: \"kubernetes.io/projected/4043d803-9ff8-4532-b372-4d51b2c189df-kube-api-access-rz95m\") pod \"ovnkube-node-5xjz6\" (UID: \"4043d803-9ff8-4532-b372-4d51b2c189df\") " pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.661840 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.661815 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8x52\" (UniqueName: \"kubernetes.io/projected/bbcf5672-85e2-4811-99f3-fc26314acb03-kube-api-access-s8x52\") pod \"multus-phszj\" (UID: \"bbcf5672-85e2-4811-99f3-fc26314acb03\") " pod="openshift-multus/multus-phszj" Jul 22 16:21:04.700376 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.700342 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:04.754266 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-device-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754266 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-os-release\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.754462 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysctl-d\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754462 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754353 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-os-release\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.754462 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754359 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-device-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754462 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754462 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-modprobe-d\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754462 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-lib-modules\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-modprobe-d\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e21a90a5-7d55-49c6-9576-21ce020c4443-iptables-alerter-script\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysctl-d\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754568 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95140c89-1077-4a8c-be4c-4a72f2b3784a-host\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-registration-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754618 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95140c89-1077-4a8c-be4c-4a72f2b3784a-host\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-tuned\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754646 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-lib-modules\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754673 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-registration-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-socket-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.754767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysconfig\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.755308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96ac3a20-6e4d-4f3a-bed1-37320630118b-kubelet-config\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.755308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d3572e8-4046-49f3-bd59-eb7fa08defba-agent-certs\") pod \"konnectivity-agent-dxzrj\" (UID: \"5d3572e8-4046-49f3-bd59-eb7fa08defba\") " pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.755308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysctl-conf\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.755308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-var-lib-kubelet\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.755757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754937 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/96ac3a20-6e4d-4f3a-bed1-37320630118b-kubelet-config\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.755757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.755686 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-var-lib-kubelet\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.755757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.755705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysconfig\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.755757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.755751 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-sysctl-conf\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.756058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.755882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqdp6\" (UniqueName: \"kubernetes.io/projected/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-kube-api-access-zqdp6\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.756058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.755928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:04.756058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.755981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjfw\" (UniqueName: \"kubernetes.io/projected/61dc5eac-5eb0-4285-8558-b077073bb35a-kube-api-access-ldjfw\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:04.756058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756006 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e21a90a5-7d55-49c6-9576-21ce020c4443-iptables-alerter-script\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.756058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.756302 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-sys-fs\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.756302 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.756157 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:04.756302 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-cnibin\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.756302 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.756266 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:21:05.256220228 +0000 UTC m=+2.009156377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:04.756302 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756262 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-cnibin\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.756559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.756559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.756559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.754833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-socket-dir\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.756559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756420 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e1b6142-c64c-4156-b166-ed7659b4df6c-sys-fs\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.756559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh9bl\" (UniqueName: \"kubernetes.io/projected/95140c89-1077-4a8c-be4c-4a72f2b3784a-kube-api-access-nh9bl\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.756820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-system-cni-dir\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.756820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.756820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d3572e8-4046-49f3-bd59-eb7fa08defba-konnectivity-ca\") pod \"konnectivity-agent-dxzrj\" (UID: \"5d3572e8-4046-49f3-bd59-eb7fa08defba\") " pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.756820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-sys\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.756820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756782 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-sys\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.756820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756784 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-system-cni-dir\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.757197 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756849 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.757197 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.756978 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5d2d768-868c-4da9-b944-d78aa18eda4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.757197 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.757197 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-kubernetes\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.757197 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6hbq\" (UniqueName: \"kubernetes.io/projected/e21a90a5-7d55-49c6-9576-21ce020c4443-kube-api-access-b6hbq\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.757450 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-systemd\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.757450 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95140c89-1077-4a8c-be4c-4a72f2b3784a-serviceca\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.757450 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e21a90a5-7d55-49c6-9576-21ce020c4443-host-slash\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.757450 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-run\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.757673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.757673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-host\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.757673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-tmp\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.757673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xsbf\" (UniqueName: \"kubernetes.io/projected/5e1b6142-c64c-4156-b166-ed7659b4df6c-kube-api-access-2xsbf\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.757673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqccj\" (UniqueName: \"kubernetes.io/projected/c5d2d768-868c-4da9-b944-d78aa18eda4e-kube-api-access-mqccj\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.758047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96ac3a20-6e4d-4f3a-bed1-37320630118b-dbus\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.758047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.757859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/96ac3a20-6e4d-4f3a-bed1-37320630118b-dbus\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:04.758224 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758183 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-kubernetes\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.758224 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758182 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.758565 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758380 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-systemd\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.758565 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758462 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-host\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.758565 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.758520 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:04.758565 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758547 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-etc-tuned\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758723 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5d2d768-868c-4da9-b944-d78aa18eda4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.758980 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d3572e8-4046-49f3-bd59-eb7fa08defba-konnectivity-ca\") pod \"konnectivity-agent-dxzrj\" (UID: \"5d3572e8-4046-49f3-bd59-eb7fa08defba\") " pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.759020 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:21:05.258881845 +0000 UTC m=+2.011817996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.759035 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e21a90a5-7d55-49c6-9576-21ce020c4443-host-slash\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.759188 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d3572e8-4046-49f3-bd59-eb7fa08defba-agent-certs\") pod \"konnectivity-agent-dxzrj\" (UID: \"5d3572e8-4046-49f3-bd59-eb7fa08defba\") " pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.759286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-run\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.759658 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95140c89-1077-4a8c-be4c-4a72f2b3784a-serviceca\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.761131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.760801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-tmp\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.761959 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.761938 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:04.762058 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.761964 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:04.762058 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.761976 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:04.762058 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:04.762030 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:05.262014917 +0000 UTC m=+2.014951046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:04.767853 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.767831 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqdp6\" (UniqueName: \"kubernetes.io/projected/5c3a10bb-6acc-4cb4-b6fb-a89805dd3885-kube-api-access-zqdp6\") pod \"tuned-4rfn8\" (UID: \"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885\") " pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.768060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.768042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjfw\" (UniqueName: \"kubernetes.io/projected/61dc5eac-5eb0-4285-8558-b077073bb35a-kube-api-access-ldjfw\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:04.769532 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.769510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh9bl\" (UniqueName: \"kubernetes.io/projected/95140c89-1077-4a8c-be4c-4a72f2b3784a-kube-api-access-nh9bl\") pod \"node-ca-9vrh9\" (UID: \"95140c89-1077-4a8c-be4c-4a72f2b3784a\") " pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.769806 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.769787 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6hbq\" (UniqueName: \"kubernetes.io/projected/e21a90a5-7d55-49c6-9576-21ce020c4443-kube-api-access-b6hbq\") pod \"iptables-alerter-fl8xz\" (UID: \"e21a90a5-7d55-49c6-9576-21ce020c4443\") " pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.769863 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.769801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xsbf\" (UniqueName: \"kubernetes.io/projected/5e1b6142-c64c-4156-b166-ed7659b4df6c-kube-api-access-2xsbf\") pod \"aws-ebs-csi-driver-node-9bd7q\" (UID: \"5e1b6142-c64c-4156-b166-ed7659b4df6c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.769863 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.769787 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqccj\" (UniqueName: \"kubernetes.io/projected/c5d2d768-868c-4da9-b944-d78aa18eda4e-kube-api-access-mqccj\") pod \"multus-additional-cni-plugins-qbk5v\" (UID: \"c5d2d768-868c-4da9-b944-d78aa18eda4e\") " pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:04.869067 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.868965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5w78n" Jul 22 16:21:04.884760 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.884732 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phszj" Jul 22 16:21:04.902785 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.902757 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:04.916540 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.916507 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:04.925569 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.925547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" Jul 22 16:21:04.941998 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.941967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9vrh9" Jul 22 16:21:04.955968 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.955945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" Jul 22 16:21:04.971881 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.971833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fl8xz" Jul 22 16:21:04.975968 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:04.975942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" Jul 22 16:21:05.145402 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.145356 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bdd73f41c9a28bcba61f6b3daf713b.slice/crio-87474c20cfe50581577122fc3c2764989bbe73e82bfc30190bdb315cdc8bf307 WatchSource:0}: Error finding container 87474c20cfe50581577122fc3c2764989bbe73e82bfc30190bdb315cdc8bf307: Status 404 returned error can't find the container with id 87474c20cfe50581577122fc3c2764989bbe73e82bfc30190bdb315cdc8bf307 Jul 22 16:21:05.150706 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:05.150685 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:21:05.156297 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.156270 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ef05445162f1383037c1357bbb8630.slice/crio-cd86a36ea33df3a2773ae27eda1ad74c91b2b6568e640a555e5ef27384007234 WatchSource:0}: Error finding container cd86a36ea33df3a2773ae27eda1ad74c91b2b6568e640a555e5ef27384007234: Status 404 returned error can't find the container with id cd86a36ea33df3a2773ae27eda1ad74c91b2b6568e640a555e5ef27384007234 Jul 22 16:21:05.260936 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:05.260790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:05.261119 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.260944 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:05.261119 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:05.260991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:05.261119 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.261052 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:21:06.261013485 +0000 UTC m=+3.013949637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:05.261119 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.261070 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:05.261119 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.261115 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:21:06.261099765 +0000 UTC m=+3.014035895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:05.308245 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.308212 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4043d803_9ff8_4532_b372_4d51b2c189df.slice/crio-b66365bbf124fcbaccf3f1524716da8878e2691ab3fb97d154a77c607e4ebf81 WatchSource:0}: Error finding container b66365bbf124fcbaccf3f1524716da8878e2691ab3fb97d154a77c607e4ebf81: Status 404 returned error can't find the container with id b66365bbf124fcbaccf3f1524716da8878e2691ab3fb97d154a77c607e4ebf81 Jul 22 16:21:05.335615 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.335581 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3a10bb_6acc_4cb4_b6fb_a89805dd3885.slice/crio-3e293fa85f81afc78633ff220550df5f74d9dcb9e36095ebc5fc76af06e1049f WatchSource:0}: Error finding container 3e293fa85f81afc78633ff220550df5f74d9dcb9e36095ebc5fc76af06e1049f: Status 404 returned error can't find the container with id 3e293fa85f81afc78633ff220550df5f74d9dcb9e36095ebc5fc76af06e1049f Jul 22 16:21:05.336215 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.336195 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1b6142_c64c_4156_b166_ed7659b4df6c.slice/crio-6a2a6f65db8bd040bee32ce91f866444f8f51f5607d8854ce420ee8a69c33a2d WatchSource:0}: Error finding container 6a2a6f65db8bd040bee32ce91f866444f8f51f5607d8854ce420ee8a69c33a2d: Status 404 returned error can't find the container with id 6a2a6f65db8bd040bee32ce91f866444f8f51f5607d8854ce420ee8a69c33a2d Jul 22 16:21:05.361532 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:05.361498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:05.361713 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.361685 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:05.361713 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.361710 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:05.361796 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.361723 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:05.361796 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:05.361784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:06.361768416 +0000 UTC m=+3.114704546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:05.397383 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.397350 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3572e8_4046_49f3_bd59_eb7fa08defba.slice/crio-d68b9162ccefb807ebc6c47b751e8190e56d8b6524c0cc1102578edd02fae186 WatchSource:0}: Error finding container d68b9162ccefb807ebc6c47b751e8190e56d8b6524c0cc1102578edd02fae186: Status 404 returned error can't find the container with id d68b9162ccefb807ebc6c47b751e8190e56d8b6524c0cc1102578edd02fae186 Jul 22 16:21:05.402486 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.402454 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95140c89_1077_4a8c_be4c_4a72f2b3784a.slice/crio-a5c87250d133ed1ba2db5554b395e971ba74a579bacb42902d5b8213abdc3d62 WatchSource:0}: Error finding container a5c87250d133ed1ba2db5554b395e971ba74a579bacb42902d5b8213abdc3d62: Status 404 returned error can't find the container with id a5c87250d133ed1ba2db5554b395e971ba74a579bacb42902d5b8213abdc3d62 Jul 22 16:21:05.406627 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.406594 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcf5672_85e2_4811_99f3_fc26314acb03.slice/crio-4dbd7ff578c3a79c36047d92b9958ed25eacb218b7705e3ced619322c0115c8c WatchSource:0}: Error finding container 4dbd7ff578c3a79c36047d92b9958ed25eacb218b7705e3ced619322c0115c8c: Status 404 returned error can't find the container with id 4dbd7ff578c3a79c36047d92b9958ed25eacb218b7705e3ced619322c0115c8c Jul 22 16:21:05.409274 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.409248 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d2d768_868c_4da9_b944_d78aa18eda4e.slice/crio-b067a4ceb5f59b426d0d6d750eb4041a642244a599df285ef7f030746036efbc WatchSource:0}: Error finding container b067a4ceb5f59b426d0d6d750eb4041a642244a599df285ef7f030746036efbc: Status 404 returned error can't find the container with id b067a4ceb5f59b426d0d6d750eb4041a642244a599df285ef7f030746036efbc Jul 22 16:21:05.445680 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.445646 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21a90a5_7d55_49c6_9576_21ce020c4443.slice/crio-c5f956e7822a7b2a67ca0e2dacf189aedab87723a87f5a260379bb7b85d8367b WatchSource:0}: Error finding container c5f956e7822a7b2a67ca0e2dacf189aedab87723a87f5a260379bb7b85d8367b: Status 404 returned error can't find the container with id c5f956e7822a7b2a67ca0e2dacf189aedab87723a87f5a260379bb7b85d8367b Jul 22 16:21:05.589188 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:05.589123 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:16:05 +0000 UTC" deadline="2028-02-24 13:12:06.214681375 +0000 UTC" Jul 22 16:21:05.589188 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:05.589176 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13964h51m0.625507808s" Jul 22 16:21:05.667658 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:05.667618 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b9e9f0_f2c0_4700_bf95_ab445d7d3830.slice/crio-ff6ec2d4694a9379df1ac40c6cf7e27bbcb75caa1dd131fefd5e168daec5e20f WatchSource:0}: Error finding container ff6ec2d4694a9379df1ac40c6cf7e27bbcb75caa1dd131fefd5e168daec5e20f: Status 404 returned error can't find the container with id ff6ec2d4694a9379df1ac40c6cf7e27bbcb75caa1dd131fefd5e168daec5e20f Jul 22 16:21:06.081576 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.081539 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:06.100888 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.100040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:06.100888 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.100178 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:06.100888 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.100601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:06.100888 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.100709 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:06.101607 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.101353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:06.101607 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.101458 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:06.135651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.135527 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" event={"ID":"5e1b6142-c64c-4156-b166-ed7659b4df6c","Type":"ContainerStarted","Data":"6a2a6f65db8bd040bee32ce91f866444f8f51f5607d8854ce420ee8a69c33a2d"} Jul 22 16:21:06.150213 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.150170 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phszj" event={"ID":"bbcf5672-85e2-4811-99f3-fc26314acb03","Type":"ContainerStarted","Data":"4dbd7ff578c3a79c36047d92b9958ed25eacb218b7705e3ced619322c0115c8c"} Jul 22 16:21:06.159108 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.159027 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9vrh9" event={"ID":"95140c89-1077-4a8c-be4c-4a72f2b3784a","Type":"ContainerStarted","Data":"a5c87250d133ed1ba2db5554b395e971ba74a579bacb42902d5b8213abdc3d62"} Jul 22 16:21:06.164755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.164688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" event={"ID":"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885","Type":"ContainerStarted","Data":"3e293fa85f81afc78633ff220550df5f74d9dcb9e36095ebc5fc76af06e1049f"} Jul 22 16:21:06.187181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.187135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"b66365bbf124fcbaccf3f1524716da8878e2691ab3fb97d154a77c607e4ebf81"} Jul 22 16:21:06.203960 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.203896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" event={"ID":"68ef05445162f1383037c1357bbb8630","Type":"ContainerStarted","Data":"cd86a36ea33df3a2773ae27eda1ad74c91b2b6568e640a555e5ef27384007234"} Jul 22 16:21:06.209852 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.209814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"33bdd73f41c9a28bcba61f6b3daf713b","Type":"ContainerStarted","Data":"87474c20cfe50581577122fc3c2764989bbe73e82bfc30190bdb315cdc8bf307"} Jul 22 16:21:06.215963 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.215930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5w78n" event={"ID":"07b9e9f0-f2c0-4700-bf95-ab445d7d3830","Type":"ContainerStarted","Data":"ff6ec2d4694a9379df1ac40c6cf7e27bbcb75caa1dd131fefd5e168daec5e20f"} Jul 22 16:21:06.232713 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.232671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fl8xz" event={"ID":"e21a90a5-7d55-49c6-9576-21ce020c4443","Type":"ContainerStarted","Data":"c5f956e7822a7b2a67ca0e2dacf189aedab87723a87f5a260379bb7b85d8367b"} Jul 22 16:21:06.246146 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.246106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerStarted","Data":"b067a4ceb5f59b426d0d6d750eb4041a642244a599df285ef7f030746036efbc"} Jul 22 16:21:06.268256 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.268166 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxzrj" event={"ID":"5d3572e8-4046-49f3-bd59-eb7fa08defba","Type":"ContainerStarted","Data":"d68b9162ccefb807ebc6c47b751e8190e56d8b6524c0cc1102578edd02fae186"} Jul 22 16:21:06.269193 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.269162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:06.269308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.269235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:06.269418 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.269395 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:06.269418 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.269413 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:06.269554 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.269477 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:21:08.269454887 +0000 UTC m=+5.022391034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:06.269554 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.269499 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:21:08.269488079 +0000 UTC m=+5.022424214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:06.369785 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.369686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:06.369978 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.369918 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:06.369978 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.369950 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:06.369978 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.369966 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:06.370155 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:06.370030 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:08.37000932 +0000 UTC m=+5.122945465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:06.468381 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.468306 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:06.590320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.590241 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 16:16:05 +0000 UTC" deadline="2028-04-11 11:47:27.4073656 +0000 UTC" Jul 22 16:21:06.590320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:06.590323 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15091h26m20.817047408s" Jul 22 16:21:07.606688 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:07.606656 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 16:21:08.099811 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:08.099065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:08.099811 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.099204 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:08.099811 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:08.099660 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:08.099811 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.099753 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:08.100499 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:08.100277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:08.100499 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.100397 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:08.286796 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:08.286453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:08.286796 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:08.286545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:08.286796 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.286634 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:08.286796 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.286667 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:08.286796 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.286733 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:21:12.286708204 +0000 UTC m=+9.039644337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:08.286796 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.286757 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:21:12.286744705 +0000 UTC m=+9.039680841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:08.387461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:08.387424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:08.387660 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.387614 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:08.387660 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.387635 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:08.387660 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.387647 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:08.387825 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:08.387703 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:12.387683713 +0000 UTC m=+9.140619848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:10.099079 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:10.099042 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:10.099583 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:10.099206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:10.099583 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:10.099250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:10.099583 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:10.099370 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:10.099583 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:10.099529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:10.099823 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:10.099620 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:12.098589 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:12.098506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:12.099137 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.098659 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:12.099211 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:12.099139 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:12.099271 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.099247 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:12.099373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:12.099342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:12.099530 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.099428 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:12.324117 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:12.324061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:12.324330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:12.324159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:12.324330 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.324248 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:12.324330 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.324284 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:12.324330 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.324327 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:21:20.324307076 +0000 UTC m=+17.077243220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:12.324555 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.324351 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:21:20.324340144 +0000 UTC m=+17.077276280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:12.425130 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:12.425044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:12.425322 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.425223 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:12.425322 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.425238 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:12.425322 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.425248 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:12.425322 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:12.425303 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:20.425284047 +0000 UTC m=+17.178220179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:14.098774 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:14.098741 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:14.099246 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:14.098876 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:14.099246 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:14.099232 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:14.099404 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:14.099349 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:14.099404 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:14.099396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:14.099506 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:14.099468 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:16.098510 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:16.098478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:16.098988 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:16.098479 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:16.098988 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:16.098602 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:16.098988 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:16.098624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:16.098988 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:16.098728 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:16.098988 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:16.098822 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:18.098071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:18.098036 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:18.098519 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:18.098169 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:18.098519 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:18.098044 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:18.098519 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:18.098044 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:18.098519 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:18.098273 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:18.098519 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:18.098353 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:20.098773 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:20.098731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:20.098773 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:20.098769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:20.099304 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:20.098733 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:20.099304 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.098901 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:20.099304 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.099000 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:20.099304 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.099081 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:20.388450 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:20.388379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:20.388595 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:20.388456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:20.388595 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.388539 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:20.388595 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.388556 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:20.388727 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.388618 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:21:36.388597825 +0000 UTC m=+33.141533968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:20.388727 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.388638 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:21:36.388628823 +0000 UTC m=+33.141564954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:20.489827 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:20.489791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:20.490017 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.489944 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:20.490017 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.489965 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:20.490017 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.489977 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:20.490131 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:20.490029 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:36.490016134 +0000 UTC m=+33.242952277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:22.098511 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:22.098440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:22.098511 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:22.098503 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:22.099056 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:22.098459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:22.099056 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:22.098588 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:22.099056 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:22.098705 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:22.099056 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:22.098798 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:24.099097 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:24.099024 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:24.099097 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:24.099114 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:24.099622 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:24.099157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:24.099622 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:24.099239 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:24.099622 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:24.099230 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:24.099622 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:24.099404 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:26.098233 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.098201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:26.098678 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.098201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:26.098678 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:26.098350 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:26.098678 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.098208 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:26.098678 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:26.098376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:26.098678 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:26.098446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:26.334954 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.334239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" event={"ID":"5c3a10bb-6acc-4cb4-b6fb-a89805dd3885","Type":"ContainerStarted","Data":"05e2d1b1b4eb7ef933dd208e67b0e831fa44556537e9160f547d293138211b4e"} Jul 22 16:21:26.341431 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.341398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" event={"ID":"68ef05445162f1383037c1357bbb8630","Type":"ContainerStarted","Data":"d9c3472be42c47de609858fde6714235956dab070b85c4bec8e8279338cb4831"} Jul 22 16:21:26.360471 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.360394 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4rfn8" podStartSLOduration=1.545068094 podStartE2EDuration="22.360374835s" totalImagesPullingTime="20.815306741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:26.360013461 +0000 UTC m=+23.112949612" watchObservedRunningTime="2026-07-22 16:21:26.360374835 +0000 UTC m=+23.113310986" Jul 22 16:21:26.383670 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:26.383624 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-phszj" podStartSLOduration=1.582588893 podStartE2EDuration="22.383607677s" totalImagesPullingTime="20.801018784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:26.383177228 +0000 UTC m=+23.136113377" watchObservedRunningTime="2026-07-22 16:21:26.383607677 +0000 UTC m=+23.136543826" Jul 22 16:21:27.358190 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.357963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5w78n" event={"ID":"07b9e9f0-f2c0-4700-bf95-ab445d7d3830","Type":"ContainerStarted","Data":"ae81ca18b0a34c74061dbe5fbd3d738dba1f52cdf78c6fa175f876c77fbb0d04"} Jul 22 16:21:27.359445 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.359419 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5d2d768-868c-4da9-b944-d78aa18eda4e" containerID="566ef71be5bc01a14261244d61c8844bc4f69f0026e02b3348a2afcd19078b09" exitCode=0 Jul 22 16:21:27.359538 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.359511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerDied","Data":"566ef71be5bc01a14261244d61c8844bc4f69f0026e02b3348a2afcd19078b09"} Jul 22 16:21:27.360951 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.360918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dxzrj" event={"ID":"5d3572e8-4046-49f3-bd59-eb7fa08defba","Type":"ContainerStarted","Data":"97fab313b1e0231e25b1df63bf70b4a93cbf03cd967fb0c4fccbc38252ce90f4"} Jul 22 16:21:27.362406 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.362364 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" event={"ID":"5e1b6142-c64c-4156-b166-ed7659b4df6c","Type":"ContainerStarted","Data":"c2e584ca6d7bfb67db1cc6f552bf246faa5566801bb081fb8411619c400aca0f"} Jul 22 16:21:27.363726 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.363709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phszj" event={"ID":"bbcf5672-85e2-4811-99f3-fc26314acb03","Type":"ContainerStarted","Data":"10b6720d1ed9a900e8a3edcb78d7568e1adda67fa5324a17bddb5ef41ac09345"} Jul 22 16:21:27.365061 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.365038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9vrh9" event={"ID":"95140c89-1077-4a8c-be4c-4a72f2b3784a","Type":"ContainerStarted","Data":"c5f7a88206d23d71689415a9c2d7ca5e872d0fd300ded45d22907927135e7b84"} Jul 22 16:21:27.367662 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.367645 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"515d729d2cd50d637a386040256b8fba6eaeb96b861ca767e757646821990c6d"} Jul 22 16:21:27.367741 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.367699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"dfa7af3375f6975242a2c2821bde7514792077dfb35be89a8d5997fb598d7d2f"} Jul 22 16:21:27.367741 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.367730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"d3e63e57e6373850241b4719d4cc08f92401defadfb0d510a36f84f1efbd97ee"} Jul 22 16:21:27.367814 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.367773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"441ca601afa07d89b7318c1adc318b468c7e4af01c409b52db6e435fc600e289"} Jul 22 16:21:27.367874 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.367851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"99b63c58f67b570330e022eb4cfaddadfec4636f25ffe44912229a284f63b8ac"} Jul 22 16:21:27.367909 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.367898 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"24cdaf1afba0bc834e41e9862171523c5e8f0ce7f7cdc06e9845b125e62c7160"} Jul 22 16:21:27.368984 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.368963 2574 generic.go:356] "Generic (PLEG): container finished" podID="33bdd73f41c9a28bcba61f6b3daf713b" containerID="a1b9072590f6955c55bb54fb6768008aa54ccbad05725ecac9e430f3c1f8fa11" exitCode=0 Jul 22 16:21:27.369069 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.369010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"33bdd73f41c9a28bcba61f6b3daf713b","Type":"ContainerDied","Data":"a1b9072590f6955c55bb54fb6768008aa54ccbad05725ecac9e430f3c1f8fa11"} Jul 22 16:21:27.376349 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.376312 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-30.ec2.internal" podStartSLOduration=22.37629969 podStartE2EDuration="22.37629969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:26.400418579 +0000 UTC m=+23.153354729" watchObservedRunningTime="2026-07-22 16:21:27.37629969 +0000 UTC m=+24.129235888" Jul 22 16:21:27.376449 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.376425 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5w78n" podStartSLOduration=2.88624204 podStartE2EDuration="23.376419865s" totalImagesPullingTime="20.490177825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:27.375692973 +0000 UTC m=+24.128629122" watchObservedRunningTime="2026-07-22 16:21:27.376419865 +0000 UTC m=+24.129356015" Jul 22 16:21:27.406526 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.406478 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dxzrj" podStartSLOduration=2.661629686 podStartE2EDuration="23.406460682s" totalImagesPullingTime="20.744830996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:27.406044461 +0000 UTC m=+24.158980611" watchObservedRunningTime="2026-07-22 16:21:27.406460682 +0000 UTC m=+24.159396843" Jul 22 16:21:27.423826 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.423783 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9vrh9" podStartSLOduration=2.683768423 podStartE2EDuration="23.423766739s" totalImagesPullingTime="20.739998316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:27.423247094 +0000 UTC m=+24.176183246" watchObservedRunningTime="2026-07-22 16:21:27.423766739 +0000 UTC m=+24.176702918" Jul 22 16:21:27.519511 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.519303 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:27.595225 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.595190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:27.940258 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:27.940236 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 16:21:28.098340 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.098248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:28.098561 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.098248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:28.098561 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:28.098382 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:28.098561 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.098248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:28.098561 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:28.098458 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:28.098825 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:28.098616 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:28.373269 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.373178 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" event={"ID":"33bdd73f41c9a28bcba61f6b3daf713b","Type":"ContainerStarted","Data":"1dc4cac3136eb4adfd456418f0289298b3ea34ca265df37f745bcaa73e2c54cb"} Jul 22 16:21:28.374788 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.374754 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fl8xz" event={"ID":"e21a90a5-7d55-49c6-9576-21ce020c4443","Type":"ContainerStarted","Data":"d0214f2c8ecdbb51255354ecfbb306676e1f1d0cb40030c984fd738019e61a61"} Jul 22 16:21:28.376678 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.376648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" event={"ID":"5e1b6142-c64c-4156-b166-ed7659b4df6c","Type":"ContainerStarted","Data":"b204529d795215b5e9b9e10a7d0c909d007a7c141be28ffd2854f6014b5595d9"} Jul 22 16:21:28.391887 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.391819 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-30.ec2.internal" podStartSLOduration=23.391804196 podStartE2EDuration="23.391804196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:28.39132289 +0000 UTC m=+25.144259054" watchObservedRunningTime="2026-07-22 16:21:28.391804196 +0000 UTC m=+25.144740347" Jul 22 16:21:28.407640 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.407588 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fl8xz" podStartSLOduration=3.695280843 podStartE2EDuration="24.407573217s" totalImagesPullingTime="20.712292374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:28.407485259 +0000 UTC m=+25.160421410" watchObservedRunningTime="2026-07-22 16:21:28.407573217 +0000 UTC m=+25.160509367" Jul 22 16:21:28.527322 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.527285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:28.623491 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.623321 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T16:21:27.940252923Z","UUID":"2c19e13f-aead-48c2-b067-fdcd2fd70a23","Handler":null,"Name":"","Endpoint":""} Jul 22 16:21:28.625757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.625729 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 16:21:28.625928 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.625784 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 16:21:28.628578 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.628541 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:28.728403 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.728366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:28.783848 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:28.783804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:29.382581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:29.382492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"4453e22022254912bf463274043fa8682e9fdc5f5ccd57c51f56a97d3fc291ff"} Jul 22 16:21:29.384949 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:29.384921 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" event={"ID":"5e1b6142-c64c-4156-b166-ed7659b4df6c","Type":"ContainerStarted","Data":"6a7019781b915f910a8e622a261081dc7668d6a59bb8f1f83f0772a16cecb6f7"} Jul 22 16:21:29.405500 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:29.405448 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bd7q" podStartSLOduration=2.311796003 podStartE2EDuration="25.405432506s" totalImagesPullingTime="23.093636503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:29.403916236 +0000 UTC m=+26.156852386" watchObservedRunningTime="2026-07-22 16:21:29.405432506 +0000 UTC m=+26.158368676" Jul 22 16:21:30.098356 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:30.098323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:30.098646 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:30.098378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:30.098646 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:30.098389 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:30.098646 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:30.098490 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:30.098646 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:30.098549 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:30.098646 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:30.098596 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:31.262411 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:31.262376 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:31.316446 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:31.316409 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:31.466897 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:31.466393 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:31.467483 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:31.467235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:32.098464 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.098222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:32.098620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.098222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:32.098620 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:32.098508 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:32.098620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.098265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:32.098620 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:32.098602 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:32.098825 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:32.098668 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:32.395287 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.395199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" event={"ID":"4043d803-9ff8-4532-b372-4d51b2c189df","Type":"ContainerStarted","Data":"45128dadc5eae415e9bd03f4d3f4b257689d4d11c3815f81497eeda5a77f48a2"} Jul 22 16:21:32.395929 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.395438 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:32.397181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.397148 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5d2d768-868c-4da9-b944-d78aa18eda4e" containerID="5ddbf9d93094b534eb5069f6ba01a7ffe320fe0596025b95e123f703698ebf08" exitCode=0 Jul 22 16:21:32.397286 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.397182 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerDied","Data":"5ddbf9d93094b534eb5069f6ba01a7ffe320fe0596025b95e123f703698ebf08"} Jul 22 16:21:32.397507 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.397492 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:32.398244 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.398142 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dxzrj" Jul 22 16:21:32.411033 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.411014 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:32.427069 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.427028 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" podStartSLOduration=7.510617997 podStartE2EDuration="28.427013265s" totalImagesPullingTime="20.916395268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:32.425277383 +0000 UTC m=+29.178213534" watchObservedRunningTime="2026-07-22 16:21:32.427013265 +0000 UTC m=+29.179949414" Jul 22 16:21:32.532100 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.532065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:32.819329 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:32.819307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5w78n_07b9e9f0-f2c0-4700-bf95-ab445d7d3830/dns-node-resolver/0.log" Jul 22 16:21:33.401020 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.400856 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:33.401619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.401110 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:33.416960 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.416934 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:21:33.417828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.417809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9vrh9_95140c89-1077-4a8c-be4c-4a72f2b3784a/node-ca/0.log" Jul 22 16:21:33.606226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.606159 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-72lmt"] Jul 22 16:21:33.606882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.606310 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:33.606882 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:33.606432 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:33.607023 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.606941 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4tpzx"] Jul 22 16:21:33.607076 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.607032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:33.607126 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:33.607110 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:33.619185 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.619085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5qd2x"] Jul 22 16:21:33.619317 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:33.619198 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:33.619317 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:33.619291 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:33.643270 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:33.643237 2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d2d768_868c_4da9_b944_d78aa18eda4e.slice/crio-conmon-54665d5ecae8355181947e6bea75444be5fca63ef929194ac8eba7fd20d1767a.scope\": RecentStats: unable to find data in memory cache]" Jul 22 16:21:34.404809 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:34.404770 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5d2d768-868c-4da9-b944-d78aa18eda4e" containerID="54665d5ecae8355181947e6bea75444be5fca63ef929194ac8eba7fd20d1767a" exitCode=0 Jul 22 16:21:34.405324 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:34.404873 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerDied","Data":"54665d5ecae8355181947e6bea75444be5fca63ef929194ac8eba7fd20d1767a"} Jul 22 16:21:35.098390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:35.098352 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:35.098551 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:35.098459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:35.098591 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:35.098549 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:35.098591 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:35.098464 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:35.098591 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:35.098466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:35.098720 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:35.098640 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:35.887961 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:35.887888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:35.949960 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:35.949933 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:36.405300 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.405264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:36.405492 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.405322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:36.405492 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.405409 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:36.405492 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.405417 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:36.405492 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.405459 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs podName:61dc5eac-5eb0-4285-8558-b077073bb35a nodeName:}" failed. No retries permitted until 2026-07-22 16:22:08.4054473 +0000 UTC m=+65.158383428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs") pod "network-metrics-daemon-72lmt" (UID: "61dc5eac-5eb0-4285-8558-b077073bb35a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 16:21:36.405492 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.405481 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret podName:96ac3a20-6e4d-4f3a-bed1-37320630118b nodeName:}" failed. No retries permitted until 2026-07-22 16:22:08.40546441 +0000 UTC m=+65.158400541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret") pod "global-pull-secret-syncer-5qd2x" (UID: "96ac3a20-6e4d-4f3a-bed1-37320630118b") : object "kube-system"/"original-pull-secret" not registered Jul 22 16:21:36.411166 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.411139 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5d2d768-868c-4da9-b944-d78aa18eda4e" containerID="7fb4cbd425ca4b2ac9fffaa0df4c857dab0f92639b5bea712c057d10375dda96" exitCode=0 Jul 22 16:21:36.411266 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.411179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerDied","Data":"7fb4cbd425ca4b2ac9fffaa0df4c857dab0f92639b5bea712c057d10375dda96"} Jul 22 16:21:36.506350 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.506312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:36.506536 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.506453 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 16:21:36.506536 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.506481 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 16:21:36.506536 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.506491 2574 projected.go:196] Error preparing data for projected volume kube-api-access-tcc2g for pod openshift-network-diagnostics/network-check-target-4tpzx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:36.506664 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:36.506545 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g podName:bcf23596-b04b-4214-83f5-3d43d6b907b7 nodeName:}" failed. No retries permitted until 2026-07-22 16:22:08.506528392 +0000 UTC m=+65.259464532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcc2g" (UniqueName: "kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g") pod "network-check-target-4tpzx" (UID: "bcf23596-b04b-4214-83f5-3d43d6b907b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 16:21:36.825328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.825296 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:36.935615 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.935582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:36.999292 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:36.999262 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:37.097905 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:37.097820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:37.098069 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:37.097820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:37.098069 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:37.097960 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:37.098069 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:37.097820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:37.098069 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:37.098054 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:37.098245 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:37.098126 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:38.245567 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:38.245524 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:38.346310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:38.346265 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:38.955494 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:38.955458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:39.053676 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:39.053630 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:39.098691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:39.098657 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:39.098920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:39.098660 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:39.098920 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:39.098786 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-72lmt" podUID="61dc5eac-5eb0-4285-8558-b077073bb35a" Jul 22 16:21:39.098920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:39.098799 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:39.098920 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:39.098902 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tpzx" podUID="bcf23596-b04b-4214-83f5-3d43d6b907b7" Jul 22 16:21:39.099137 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:39.098977 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5qd2x" podUID="96ac3a20-6e4d-4f3a-bed1-37320630118b" Jul 22 16:21:39.756564 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:39.756528 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:39.857135 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:39.857100 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:40.026662 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.026613 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-30.ec2.internal" event="NodeReady" Jul 22 16:21:40.026868 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.026778 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 16:21:40.075183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.075145 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ffgh6"] Jul 22 16:21:40.107076 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.107036 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2hvwb"] Jul 22 16:21:40.107076 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.107058 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.109633 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.109607 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 16:21:40.109772 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.109661 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 16:21:40.109772 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.109753 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 16:21:40.109892 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.109788 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-km9pf\"" Jul 22 16:21:40.109892 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.109753 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 16:21:40.120882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.120824 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffgh6"] Jul 22 16:21:40.121033 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.120896 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2hvwb"] Jul 22 16:21:40.121033 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.120917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.121145 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.120917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:21:40.123946 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.123923 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 16:21:40.124211 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.123975 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 16:21:40.124211 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.124105 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4ntcb\"" Jul 22 16:21:40.124338 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.124252 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 16:21:40.124788 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.124759 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 16:21:40.124896 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.124852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qdrm\"" Jul 22 16:21:40.175543 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.175509 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qvv4v"] Jul 22 16:21:40.195047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.195018 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qvv4v"] Jul 22 16:21:40.195210 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.195119 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.197528 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.197505 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4chrv\"" Jul 22 16:21:40.197668 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.197529 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 16:21:40.197668 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.197505 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 16:21:40.197814 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.197664 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 16:21:40.235120 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2fb2417-b18e-49c5-82fb-9736e68a5df3-crio-socket\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.235287 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.235287 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-config-volume\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.235287 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ccww\" (UniqueName: \"kubernetes.io/projected/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-kube-api-access-6ccww\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.235287 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.235461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2fb2417-b18e-49c5-82fb-9736e68a5df3-data-volume\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.235461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hps4b\" (UniqueName: \"kubernetes.io/projected/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-api-access-hps4b\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.235461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235411 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.235461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.235449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-tmp-dir\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.335850 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.335755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527a74b0-5b63-4ec9-94f8-c865104d7351-cert\") pod \"ingress-canary-qvv4v\" (UID: \"527a74b0-5b63-4ec9-94f8-c865104d7351\") " pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.335850 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.335799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2fb2417-b18e-49c5-82fb-9736e68a5df3-crio-socket\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.335850 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.335823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.335866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-config-volume\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.335889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ccww\" (UniqueName: \"kubernetes.io/projected/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-kube-api-access-6ccww\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.335934 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.336023 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.836002829 +0000 UTC m=+37.588938957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : configmap "kube-rbac-proxy" not found Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmwqt\" (UniqueName: \"kubernetes.io/projected/527a74b0-5b63-4ec9-94f8-c865104d7351-kube-api-access-cmwqt\") pod \"ingress-canary-qvv4v\" (UID: \"527a74b0-5b63-4ec9-94f8-c865104d7351\") " pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336053 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d2fb2417-b18e-49c5-82fb-9736e68a5df3-crio-socket\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2fb2417-b18e-49c5-82fb-9736e68a5df3-data-volume\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.336129 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hps4b\" (UniqueName: \"kubernetes.io/projected/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-api-access-hps4b\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.336160 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-tmp-dir\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.336241 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.83621449 +0000 UTC m=+37.589150633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : secret "insights-runtime-extractor-tls" not found Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.336310 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.336344 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls podName:f1f7e419-b504-4942-b5d7-75c4d98cd8ac nodeName:}" failed. No retries permitted until 2026-07-22 16:21:40.836331608 +0000 UTC m=+37.589267751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls") pod "dns-default-2hvwb" (UID: "f1f7e419-b504-4942-b5d7-75c4d98cd8ac") : secret "dns-default-metrics-tls" not found Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336415 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2fb2417-b18e-49c5-82fb-9736e68a5df3-data-volume\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336448 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-tmp-dir\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.336521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.336448 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-config-volume\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.346350 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.346243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ccww\" (UniqueName: \"kubernetes.io/projected/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-kube-api-access-6ccww\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.346456 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.346275 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hps4b\" (UniqueName: \"kubernetes.io/projected/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-api-access-hps4b\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.437074 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.437040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527a74b0-5b63-4ec9-94f8-c865104d7351-cert\") pod \"ingress-canary-qvv4v\" (UID: \"527a74b0-5b63-4ec9-94f8-c865104d7351\") " pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.437265 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.437107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmwqt\" (UniqueName: \"kubernetes.io/projected/527a74b0-5b63-4ec9-94f8-c865104d7351-kube-api-access-cmwqt\") pod \"ingress-canary-qvv4v\" (UID: \"527a74b0-5b63-4ec9-94f8-c865104d7351\") " pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.439589 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.439564 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527a74b0-5b63-4ec9-94f8-c865104d7351-cert\") pod \"ingress-canary-qvv4v\" (UID: \"527a74b0-5b63-4ec9-94f8-c865104d7351\") " pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.445497 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.445472 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmwqt\" (UniqueName: \"kubernetes.io/projected/527a74b0-5b63-4ec9-94f8-c865104d7351-kube-api-access-cmwqt\") pod \"ingress-canary-qvv4v\" (UID: \"527a74b0-5b63-4ec9-94f8-c865104d7351\") " pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.505646 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.505610 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qvv4v" Jul 22 16:21:40.546699 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.546666 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-khkrx"] Jul 22 16:21:40.578812 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.578779 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-khkrx"] Jul 22 16:21:40.578964 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.578903 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.580712 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.580690 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:40.581908 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.581890 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 22 16:21:40.581987 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.581895 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 22 16:21:40.582128 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.582097 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 22 16:21:40.582235 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.582171 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 22 16:21:40.582310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.582269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wdp2q\"" Jul 22 16:21:40.683236 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.683201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:40.740242 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.740209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3d1547c-6965-4ecf-a433-f388b87cfd38-signing-key\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.740422 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.740339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3d1547c-6965-4ecf-a433-f388b87cfd38-signing-cabundle\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.740480 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.740453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9cw\" (UniqueName: \"kubernetes.io/projected/f3d1547c-6965-4ecf-a433-f388b87cfd38-kube-api-access-fv9cw\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.841093 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.841054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.841619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.841114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9cw\" (UniqueName: \"kubernetes.io/projected/f3d1547c-6965-4ecf-a433-f388b87cfd38-kube-api-access-fv9cw\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.841619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.841150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:40.841619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.841199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3d1547c-6965-4ecf-a433-f388b87cfd38-signing-key\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.841619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.841228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:40.841619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.841262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3d1547c-6965-4ecf-a433-f388b87cfd38-signing-cabundle\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.841869 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.841722 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:21:40.841869 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.841800 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:41.84178055 +0000 UTC m=+38.594716699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : secret "insights-runtime-extractor-tls" not found Jul 22 16:21:40.842230 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.842209 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 16:21:40.842300 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.842264 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:41.842249763 +0000 UTC m=+38.595185906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : configmap "kube-rbac-proxy" not found Jul 22 16:21:40.843141 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.843118 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:21:40.843233 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:40.843174 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls podName:f1f7e419-b504-4942-b5d7-75c4d98cd8ac nodeName:}" failed. No retries permitted until 2026-07-22 16:21:41.843158068 +0000 UTC m=+38.596094211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls") pod "dns-default-2hvwb" (UID: "f1f7e419-b504-4942-b5d7-75c4d98cd8ac") : secret "dns-default-metrics-tls" not found Jul 22 16:21:40.844447 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.844415 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3d1547c-6965-4ecf-a433-f388b87cfd38-signing-cabundle\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.845753 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.845723 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3d1547c-6965-4ecf-a433-f388b87cfd38-signing-key\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.853912 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.853859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9cw\" (UniqueName: \"kubernetes.io/projected/f3d1547c-6965-4ecf-a433-f388b87cfd38-kube-api-access-fv9cw\") pod \"service-ca-58598695f7-khkrx\" (UID: \"f3d1547c-6965-4ecf-a433-f388b87cfd38\") " pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.887538 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.887511 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-khkrx" Jul 22 16:21:40.924809 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:40.924776 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qvv4v"] Jul 22 16:21:40.929252 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:40.929174 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527a74b0_5b63_4ec9_94f8_c865104d7351.slice/crio-3410f075dc01d73ecede01324ec0cf92328448b6b57270604ef1c1be68ad451f WatchSource:0}: Error finding container 3410f075dc01d73ecede01324ec0cf92328448b6b57270604ef1c1be68ad451f: Status 404 returned error can't find the container with id 3410f075dc01d73ecede01324ec0cf92328448b6b57270604ef1c1be68ad451f Jul 22 16:21:41.026592 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.026332 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-khkrx"] Jul 22 16:21:41.058653 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:41.058624 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d1547c_6965_4ecf_a433_f388b87cfd38.slice/crio-7a87a004b7f30bdb25559a374d3c9f7792240fafe98fd8ca5b19134c640c3f2c WatchSource:0}: Error finding container 7a87a004b7f30bdb25559a374d3c9f7792240fafe98fd8ca5b19134c640c3f2c: Status 404 returned error can't find the container with id 7a87a004b7f30bdb25559a374d3c9f7792240fafe98fd8ca5b19134c640c3f2c Jul 22 16:21:41.097852 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.097802 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:21:41.098011 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.097982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:21:41.100906 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.100880 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 16:21:41.101017 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.100885 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 16:21:41.101017 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.100926 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mc4s\"" Jul 22 16:21:41.424927 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.424794 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-khkrx" event={"ID":"f3d1547c-6965-4ecf-a433-f388b87cfd38","Type":"ContainerStarted","Data":"7a87a004b7f30bdb25559a374d3c9f7792240fafe98fd8ca5b19134c640c3f2c"} Jul 22 16:21:41.427740 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.427709 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5d2d768-868c-4da9-b944-d78aa18eda4e" containerID="ff1c97e43933bcb6c4f6c4eaefc66f3ab3b883fd982a907d557403df653ea821" exitCode=0 Jul 22 16:21:41.427873 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.427804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerDied","Data":"ff1c97e43933bcb6c4f6c4eaefc66f3ab3b883fd982a907d557403df653ea821"} Jul 22 16:21:41.428972 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.428919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qvv4v" event={"ID":"527a74b0-5b63-4ec9-94f8-c865104d7351","Type":"ContainerStarted","Data":"3410f075dc01d73ecede01324ec0cf92328448b6b57270604ef1c1be68ad451f"} Jul 22 16:21:41.564169 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.564091 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:41.850783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.850745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.850866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:41.850905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:41.850935 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:41.851004 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls podName:f1f7e419-b504-4942-b5d7-75c4d98cd8ac nodeName:}" failed. No retries permitted until 2026-07-22 16:21:43.850985059 +0000 UTC m=+40.603921213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls") pod "dns-default-2hvwb" (UID: "f1f7e419-b504-4942-b5d7-75c4d98cd8ac") : secret "dns-default-metrics-tls" not found Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:41.851022 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:41.851076 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:43.851065079 +0000 UTC m=+40.604001222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : secret "insights-runtime-extractor-tls" not found Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:41.851117 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 16:21:41.851458 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:41.851148 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:43.851138539 +0000 UTC m=+40.604074680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : configmap "kube-rbac-proxy" not found Jul 22 16:21:42.434731 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:42.434700 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5d2d768-868c-4da9-b944-d78aa18eda4e" containerID="11498e085de13e851c9c73485ce7595735d985c08dede9befc09dc0c0db6a502" exitCode=0 Jul 22 16:21:42.434913 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:42.434757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerDied","Data":"11498e085de13e851c9c73485ce7595735d985c08dede9befc09dc0c0db6a502"} Jul 22 16:21:43.369120 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:43.369083 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:43.868046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:43.868010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:43.868046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:43.868054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:43.868279 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:43.868157 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 16:21:43.868279 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:43.868173 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:21:43.868279 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:43.868178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:43.868279 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:43.868238 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:47.868216782 +0000 UTC m=+44.621152924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : configmap "kube-rbac-proxy" not found Jul 22 16:21:43.868279 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:43.868259 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:47.868249578 +0000 UTC m=+44.621185711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : secret "insights-runtime-extractor-tls" not found Jul 22 16:21:43.868433 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:43.868289 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:21:43.868433 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:43.868337 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls podName:f1f7e419-b504-4942-b5d7-75c4d98cd8ac nodeName:}" failed. No retries permitted until 2026-07-22 16:21:47.868321699 +0000 UTC m=+44.621257841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls") pod "dns-default-2hvwb" (UID: "f1f7e419-b504-4942-b5d7-75c4d98cd8ac") : secret "dns-default-metrics-tls" not found Jul 22 16:21:44.081446 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.081411 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:44.411204 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.411130 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:44.441722 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.441685 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-khkrx" event={"ID":"f3d1547c-6965-4ecf-a433-f388b87cfd38","Type":"ContainerStarted","Data":"4f2f82ee4377815b596c7fe4027916d2a90d6bd4ad35aa7930d9e1f25471a38f"} Jul 22 16:21:44.445144 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.445115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" event={"ID":"c5d2d768-868c-4da9-b944-d78aa18eda4e","Type":"ContainerStarted","Data":"cf6bdf48af9e17c15ec89f4732aa41560acc88621694e6061fc567b7445ca3ce"} Jul 22 16:21:44.446632 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.446604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qvv4v" event={"ID":"527a74b0-5b63-4ec9-94f8-c865104d7351","Type":"ContainerStarted","Data":"0a29f22a46c9cbb0002c3bc1055f6aea9e864881f4457a8af21535ab9c21aa81"} Jul 22 16:21:44.460373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.460312 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-khkrx" podStartSLOduration=1.848407387 podStartE2EDuration="4.460291103s" totalImagesPullingTime="2.611883716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:44.4590033 +0000 UTC m=+41.211939452" watchObservedRunningTime="2026-07-22 16:21:44.460291103 +0000 UTC m=+41.213227255" Jul 22 16:21:44.484214 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.484154 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qbk5v" podStartSLOduration=8.92946073 podStartE2EDuration="40.484137186s" totalImagesPullingTime="31.554676456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:44.482291761 +0000 UTC m=+41.235227911" watchObservedRunningTime="2026-07-22 16:21:44.484137186 +0000 UTC m=+41.237073339" Jul 22 16:21:44.500142 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.500091 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qvv4v" podStartSLOduration=1.7559983890000002 podStartE2EDuration="4.500070749s" totalImagesPullingTime="2.74407236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:44.499681541 +0000 UTC m=+41.252617693" watchObservedRunningTime="2026-07-22 16:21:44.500070749 +0000 UTC m=+41.253006901" Jul 22 16:21:44.737096 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.737057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:44.835234 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.835192 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:44.936397 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.936364 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:44.999684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:44.999599 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:45.095609 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:45.095573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:45.153079 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:45.153021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:45.654047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:45.654014 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:45.864930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:45.864887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:46.853608 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:46.853573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:47.056447 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.056407 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:47.449986 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.449957 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:47.646465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.646436 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:47.900614 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.900524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:47.900614 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.900598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:47.901062 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.900630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:47.901062 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:47.900680 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 16:21:47.901062 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:47.900736 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 16:21:47.901062 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:47.900746 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls podName:f1f7e419-b504-4942-b5d7-75c4d98cd8ac nodeName:}" failed. No retries permitted until 2026-07-22 16:21:55.900729742 +0000 UTC m=+52.653665869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls") pod "dns-default-2hvwb" (UID: "f1f7e419-b504-4942-b5d7-75c4d98cd8ac") : secret "dns-default-metrics-tls" not found Jul 22 16:21:47.901062 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:21:47.900784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls podName:d2fb2417-b18e-49c5-82fb-9736e68a5df3 nodeName:}" failed. No retries permitted until 2026-07-22 16:21:55.900772229 +0000 UTC m=+52.653708380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffgh6" (UID: "d2fb2417-b18e-49c5-82fb-9736e68a5df3") : secret "insights-runtime-extractor-tls" not found Jul 22 16:21:47.901328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.901308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d2fb2417-b18e-49c5-82fb-9736e68a5df3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:47.985048 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:47.985014 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:48.086635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:48.086582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:48.451515 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:48.451481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:48.583121 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:48.583089 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:48.684338 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:48.684305 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:49.251332 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:49.251301 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:49.455193 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:49.455155 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:49.512901 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:49.512790 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:49.653071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:49.653030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:50.052325 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:50.052292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:50.560333 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:50.560302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:50.853164 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:50.853070 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:50.953622 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:50.953594 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:51.056386 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:51.056357 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:51.447104 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:51.447071 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:51.656591 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:51.656560 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:52.247381 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:52.247350 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:52.856286 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:52.856252 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:53.053785 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:53.053752 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:53.247405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:53.247368 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:53.648433 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:53.648328 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.251002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.250966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.469985 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.469948 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.573852 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.573750 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.671993 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.671950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.771977 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.771943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.873025 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.872941 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:54.974956 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:54.974923 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.075851 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.075816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.173990 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.173911 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.274968 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.274932 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.455020 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.454988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.554946 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.554910 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.662130 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.662097 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:55.966217 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.966186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:55.966407 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.966241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:55.969386 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.969360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d2fb2417-b18e-49c5-82fb-9736e68a5df3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffgh6\" (UID: \"d2fb2417-b18e-49c5-82fb-9736e68a5df3\") " pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:55.969491 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:55.969360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1f7e419-b504-4942-b5d7-75c4d98cd8ac-metrics-tls\") pod \"dns-default-2hvwb\" (UID: \"f1f7e419-b504-4942-b5d7-75c4d98cd8ac\") " pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:56.017969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.017935 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffgh6" Jul 22 16:21:56.032124 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.032097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:56.174115 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.173986 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffgh6"] Jul 22 16:21:56.176539 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:56.176513 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fb2417_b18e_49c5_82fb_9736e68a5df3.slice/crio-91f25622d0a3b1c5a299bc14f83df8d9de505b11c29f913d8569cafe258e859b WatchSource:0}: Error finding container 91f25622d0a3b1c5a299bc14f83df8d9de505b11c29f913d8569cafe258e859b: Status 404 returned error can't find the container with id 91f25622d0a3b1c5a299bc14f83df8d9de505b11c29f913d8569cafe258e859b Jul 22 16:21:56.192379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.192346 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2hvwb"] Jul 22 16:21:56.194224 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:21:56.194186 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f7e419_b504_4942_b5d7_75c4d98cd8ac.slice/crio-c35dedafbbcf9f05176b61f815b193326723a1e9cc4920c974f0f2e4bfcd255f WatchSource:0}: Error finding container c35dedafbbcf9f05176b61f815b193326723a1e9cc4920c974f0f2e4bfcd255f: Status 404 returned error can't find the container with id c35dedafbbcf9f05176b61f815b193326723a1e9cc4920c974f0f2e4bfcd255f Jul 22 16:21:56.364298 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.364207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:56.476827 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.476791 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2hvwb" event={"ID":"f1f7e419-b504-4942-b5d7-75c4d98cd8ac","Type":"ContainerStarted","Data":"c35dedafbbcf9f05176b61f815b193326723a1e9cc4920c974f0f2e4bfcd255f"} Jul 22 16:21:56.477791 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.477771 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffgh6" event={"ID":"d2fb2417-b18e-49c5-82fb-9736e68a5df3","Type":"ContainerStarted","Data":"91f25622d0a3b1c5a299bc14f83df8d9de505b11c29f913d8569cafe258e859b"} Jul 22 16:21:56.564094 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.564066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:56.665405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.665322 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:56.988060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:56.987993 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:57.061804 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:57.061706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:21:58.487097 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:58.487051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2hvwb" event={"ID":"f1f7e419-b504-4942-b5d7-75c4d98cd8ac","Type":"ContainerStarted","Data":"e762320e208240e70ac8bfe55b5eacd5c1f243f579399fa37d50ab7b5186cc2d"} Jul 22 16:21:58.487551 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:58.487117 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2hvwb" event={"ID":"f1f7e419-b504-4942-b5d7-75c4d98cd8ac","Type":"ContainerStarted","Data":"cc8abd6f01c11b914646e856d7c1f61e26b59068655fd4f0d95442929f1babaa"} Jul 22 16:21:58.487551 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:58.487185 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2hvwb" Jul 22 16:21:58.506796 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:21:58.506742 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2hvwb" podStartSLOduration=16.531144584 podStartE2EDuration="18.506723687s" totalImagesPullingTime="1.975579103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:21:58.506435665 +0000 UTC m=+55.259371815" watchObservedRunningTime="2026-07-22 16:21:58.506723687 +0000 UTC m=+55.259659839" Jul 22 16:22:01.494826 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:01.494793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffgh6" event={"ID":"d2fb2417-b18e-49c5-82fb-9736e68a5df3","Type":"ContainerStarted","Data":"87a8879f90be5285b83f1f6bbe8aecf351d9bfad6c607b2a44b06788dec0e5d9"} Jul 22 16:22:01.543328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:01.543278 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:01.643280 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:01.643247 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:01.743545 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:01.743451 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:01.995054 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:01.994962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:02.205960 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.205926 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh"] Jul 22 16:22:02.209331 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.209155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.210165 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.210003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7"] Jul 22 16:22:02.212299 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.212275 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c6qdh\"" Jul 22 16:22:02.212579 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.212557 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 16:22:02.212931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.212770 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 16:22:02.213884 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.213624 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5"] Jul 22 16:22:02.213995 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.213941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.216797 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.216742 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 16:22:02.217176 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.217156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.218310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.217698 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 16:22:02.218310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.217723 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 22 16:22:02.218310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.217966 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wlk69\"" Jul 22 16:22:02.218310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.218140 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 16:22:02.220742 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.219748 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 22 16:22:02.220742 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.220121 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 22 16:22:02.220742 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.220332 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 22 16:22:02.220742 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.220381 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh"] Jul 22 16:22:02.220742 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.220592 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 22 16:22:02.228492 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.228437 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7"] Jul 22 16:22:02.229171 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.229149 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5"] Jul 22 16:22:02.311294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-ca\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.311294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/554a1251-d900-4c0b-9742-f4ece24c7478-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9jhkh\" (UID: \"554a1251-d900-4c0b-9742-f4ece24c7478\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.311294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b840d49-b814-4370-88bd-a69c3e417866-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/554a1251-d900-4c0b-9742-f4ece24c7478-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9jhkh\" (UID: \"554a1251-d900-4c0b-9742-f4ece24c7478\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-hub\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9bs\" (UniqueName: \"kubernetes.io/projected/3b840d49-b814-4370-88bd-a69c3e417866-kube-api-access-mx9bs\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd6969b3-e954-48e8-9f9d-7d1b4d626a09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7\" (UID: \"bd6969b3-e954-48e8-9f9d-7d1b4d626a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.311587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.311585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlctx\" (UniqueName: \"kubernetes.io/projected/bd6969b3-e954-48e8-9f9d-7d1b4d626a09-kube-api-access-nlctx\") pod \"managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7\" (UID: \"bd6969b3-e954-48e8-9f9d-7d1b4d626a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.381364 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.381325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:02.412892 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.412828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-ca\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.412899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/554a1251-d900-4c0b-9742-f4ece24c7478-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9jhkh\" (UID: \"554a1251-d900-4c0b-9742-f4ece24c7478\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.412924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.412969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.412994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b840d49-b814-4370-88bd-a69c3e417866-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.413018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/554a1251-d900-4c0b-9742-f4ece24c7478-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9jhkh\" (UID: \"554a1251-d900-4c0b-9742-f4ece24c7478\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.413042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-hub\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.413071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.413064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9bs\" (UniqueName: \"kubernetes.io/projected/3b840d49-b814-4370-88bd-a69c3e417866-kube-api-access-mx9bs\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.413442 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.413090 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd6969b3-e954-48e8-9f9d-7d1b4d626a09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7\" (UID: \"bd6969b3-e954-48e8-9f9d-7d1b4d626a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.413442 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.413120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlctx\" (UniqueName: \"kubernetes.io/projected/bd6969b3-e954-48e8-9f9d-7d1b4d626a09-kube-api-access-nlctx\") pod \"managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7\" (UID: \"bd6969b3-e954-48e8-9f9d-7d1b4d626a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.414079 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.413810 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/554a1251-d900-4c0b-9742-f4ece24c7478-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9jhkh\" (UID: \"554a1251-d900-4c0b-9742-f4ece24c7478\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.414529 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.414476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b840d49-b814-4370-88bd-a69c3e417866-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.416187 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.416132 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.416446 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.416425 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/554a1251-d900-4c0b-9742-f4ece24c7478-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9jhkh\" (UID: \"554a1251-d900-4c0b-9742-f4ece24c7478\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.416524 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.416441 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-ca\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.416663 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.416641 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-hub\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.417577 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.417557 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3b840d49-b814-4370-88bd-a69c3e417866-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.417943 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.417923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd6969b3-e954-48e8-9f9d-7d1b4d626a09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7\" (UID: \"bd6969b3-e954-48e8-9f9d-7d1b4d626a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.436062 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.436033 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlctx\" (UniqueName: \"kubernetes.io/projected/bd6969b3-e954-48e8-9f9d-7d1b4d626a09-kube-api-access-nlctx\") pod \"managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7\" (UID: \"bd6969b3-e954-48e8-9f9d-7d1b4d626a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.436197 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.436093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9bs\" (UniqueName: \"kubernetes.io/projected/3b840d49-b814-4370-88bd-a69c3e417866-kube-api-access-mx9bs\") pod \"cluster-proxy-proxy-agent-5dfc58846b-rzsp5\" (UID: \"3b840d49-b814-4370-88bd-a69c3e417866\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.469714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.469682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:02.526887 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.526792 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" Jul 22 16:22:02.546249 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.546221 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" Jul 22 16:22:02.553689 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.553658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" Jul 22 16:22:02.571585 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.571517 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:02.670069 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.670039 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:02.697333 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.697169 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh"] Jul 22 16:22:02.723599 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.723436 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7"] Jul 22 16:22:02.726513 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:02.726484 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd6969b3_e954_48e8_9f9d_7d1b4d626a09.slice/crio-e54cf4b236689c86741defbe360c368da8bf0e78686b92e0dcd331904f0e2187 WatchSource:0}: Error finding container e54cf4b236689c86741defbe360c368da8bf0e78686b92e0dcd331904f0e2187: Status 404 returned error can't find the container with id e54cf4b236689c86741defbe360c368da8bf0e78686b92e0dcd331904f0e2187 Jul 22 16:22:02.756979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:02.756945 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5"] Jul 22 16:22:02.761627 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:02.761594 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b840d49_b814_4370_88bd_a69c3e417866.slice/crio-9fb28ac8e03c9d081672074961f2c09b096289789a7cc239b24f23bd08d410f3 WatchSource:0}: Error finding container 9fb28ac8e03c9d081672074961f2c09b096289789a7cc239b24f23bd08d410f3: Status 404 returned error can't find the container with id 9fb28ac8e03c9d081672074961f2c09b096289789a7cc239b24f23bd08d410f3 Jul 22 16:22:03.501989 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.501949 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" event={"ID":"3b840d49-b814-4370-88bd-a69c3e417866","Type":"ContainerStarted","Data":"9fb28ac8e03c9d081672074961f2c09b096289789a7cc239b24f23bd08d410f3"} Jul 22 16:22:03.503212 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.503179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" event={"ID":"bd6969b3-e954-48e8-9f9d-7d1b4d626a09","Type":"ContainerStarted","Data":"e54cf4b236689c86741defbe360c368da8bf0e78686b92e0dcd331904f0e2187"} Jul 22 16:22:03.504547 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.504520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" event={"ID":"554a1251-d900-4c0b-9742-f4ece24c7478","Type":"ContainerStarted","Data":"631b7309051a391ca7117e523b3e5757eb3670b8973d3fa19eb61c0f054efe22"} Jul 22 16:22:03.590296 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.590269 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d99b5fd6-sbh4x"] Jul 22 16:22:03.691122 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.691073 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d99b5fd6-sbh4x"] Jul 22 16:22:03.691311 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.691209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.694081 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.694047 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bmnj5\"" Jul 22 16:22:03.694219 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.694049 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 16:22:03.694219 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.694050 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 16:22:03.695320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.695102 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 16:22:03.695320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.695189 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 16:22:03.695320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.695242 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 16:22:03.695320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.695321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 16:22:03.695584 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.695359 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 16:22:03.725530 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.725501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-serving-cert\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.725691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.725562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz6ng\" (UniqueName: \"kubernetes.io/projected/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-kube-api-access-gz6ng\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.725691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.725650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-service-ca\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.725791 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.725704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-oauth-config\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.725868 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.725788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-config\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.725928 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.725903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-oauth-serving-cert\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827035 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.826953 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-serving-cert\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827164 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz6ng\" (UniqueName: \"kubernetes.io/projected/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-kube-api-access-gz6ng\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827164 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-service-ca\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827164 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827118 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-oauth-config\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827164 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-config\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827359 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-oauth-serving-cert\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.827969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827942 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-service-ca\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.828101 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.827953 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-oauth-serving-cert\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.828167 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.828120 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-config\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.829568 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.829549 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-oauth-config\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.829697 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.829677 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-serving-cert\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:03.835701 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:03.835676 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz6ng\" (UniqueName: \"kubernetes.io/projected/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-kube-api-access-gz6ng\") pod \"console-64d99b5fd6-sbh4x\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:04.002681 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:04.002637 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:05.420122 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.419784 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5xjz6" Jul 22 16:22:05.480195 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.480159 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d99b5fd6-sbh4x"] Jul 22 16:22:05.548958 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.548926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:05.650265 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.650183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:05.752334 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.752302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:05.825448 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.825374 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:05.886612 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.886576 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:05.950744 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:05.950676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:06.309092 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:06.309021 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d7d1a8_9722_4ca9_9152_7eb41c58d99d.slice/crio-6cfb42d7c6ee88d4ab29433e978e35d88764a44e5228976b5e213bbbd8f0af44 WatchSource:0}: Error finding container 6cfb42d7c6ee88d4ab29433e978e35d88764a44e5228976b5e213bbbd8f0af44: Status 404 returned error can't find the container with id 6cfb42d7c6ee88d4ab29433e978e35d88764a44e5228976b5e213bbbd8f0af44 Jul 22 16:22:06.399678 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:06.399577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:06.515984 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:06.515939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d99b5fd6-sbh4x" event={"ID":"13d7d1a8-9722-4ca9-9152-7eb41c58d99d","Type":"ContainerStarted","Data":"6cfb42d7c6ee88d4ab29433e978e35d88764a44e5228976b5e213bbbd8f0af44"} Jul 22 16:22:07.522362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.522156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" event={"ID":"bd6969b3-e954-48e8-9f9d-7d1b4d626a09","Type":"ContainerStarted","Data":"b5773a1a9cb2f6754a6b1f3744df11682b10d66eedd2cc6d2459ac717312d859"} Jul 22 16:22:07.523821 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.523793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" event={"ID":"554a1251-d900-4c0b-9742-f4ece24c7478","Type":"ContainerStarted","Data":"2b84f0ded14120ce3f1ff8b2ae9bbcf9346bcbc1452c39e7185d9d98781a24b3"} Jul 22 16:22:07.526183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.526125 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffgh6" event={"ID":"d2fb2417-b18e-49c5-82fb-9736e68a5df3","Type":"ContainerStarted","Data":"f0769cc19a768478e99fe2383661adbeec931d47213f721b3124a2cd0a63381e"} Jul 22 16:22:07.539928 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.539818 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dcc74c7b-z5wv7" podStartSLOduration=1.163422744 podStartE2EDuration="5.539796113s" totalImagesPullingTime="4.376373369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:07.539152043 +0000 UTC m=+64.292088202" watchObservedRunningTime="2026-07-22 16:22:07.539796113 +0000 UTC m=+64.292732265" Jul 22 16:22:07.556275 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.556203 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9jhkh" podStartSLOduration=1.170171778 podStartE2EDuration="5.556181977s" totalImagesPullingTime="4.386010199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:07.55491409 +0000 UTC m=+64.307850241" watchObservedRunningTime="2026-07-22 16:22:07.556181977 +0000 UTC m=+64.309118125" Jul 22 16:22:07.662848 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.662797 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:07.718677 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:07.718641 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:08.472195 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.472155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:22:08.472412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.472226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:22:08.475004 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.474975 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 16:22:08.475156 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.475036 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 16:22:08.486691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.486595 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/96ac3a20-6e4d-4f3a-bed1-37320630118b-original-pull-secret\") pod \"global-pull-secret-syncer-5qd2x\" (UID: \"96ac3a20-6e4d-4f3a-bed1-37320630118b\") " pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:22:08.486691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.486607 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61dc5eac-5eb0-4285-8558-b077073bb35a-metrics-certs\") pod \"network-metrics-daemon-72lmt\" (UID: \"61dc5eac-5eb0-4285-8558-b077073bb35a\") " pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:22:08.493094 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.492596 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2hvwb" Jul 22 16:22:08.573765 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.573670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:22:08.576659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.576632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 16:22:08.587393 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.587340 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 16:22:08.598063 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.598030 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcc2g\" (UniqueName: \"kubernetes.io/projected/bcf23596-b04b-4214-83f5-3d43d6b907b7-kube-api-access-tcc2g\") pod \"network-check-target-4tpzx\" (UID: \"bcf23596-b04b-4214-83f5-3d43d6b907b7\") " pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:22:08.641329 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.641299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qdrm\"" Jul 22 16:22:08.649195 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.649168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:22:08.707544 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.707504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5qd2x" Jul 22 16:22:08.714371 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.714347 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mc4s\"" Jul 22 16:22:08.722452 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:08.722378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-72lmt" Jul 22 16:22:10.062335 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.062022 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-72lmt"] Jul 22 16:22:10.066559 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:10.066516 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61dc5eac_5eb0_4285_8558_b077073bb35a.slice/crio-005b47db0ec119e08e3d7c88a4b7b048ad1b9bb88a465adaa75a07b4af59b322 WatchSource:0}: Error finding container 005b47db0ec119e08e3d7c88a4b7b048ad1b9bb88a465adaa75a07b4af59b322: Status 404 returned error can't find the container with id 005b47db0ec119e08e3d7c88a4b7b048ad1b9bb88a465adaa75a07b4af59b322 Jul 22 16:22:10.292376 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.292347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5qd2x"] Jul 22 16:22:10.295535 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.295512 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4tpzx"] Jul 22 16:22:10.539327 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.539279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d99b5fd6-sbh4x" event={"ID":"13d7d1a8-9722-4ca9-9152-7eb41c58d99d","Type":"ContainerStarted","Data":"5decade2dbfef81789a325e93eba719414fc1db3ad213e047d77abf79fdec411"} Jul 22 16:22:10.540650 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.540623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72lmt" event={"ID":"61dc5eac-5eb0-4285-8558-b077073bb35a","Type":"ContainerStarted","Data":"005b47db0ec119e08e3d7c88a4b7b048ad1b9bb88a465adaa75a07b4af59b322"} Jul 22 16:22:10.542829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.542808 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" event={"ID":"3b840d49-b814-4370-88bd-a69c3e417866","Type":"ContainerStarted","Data":"7c6f34730f13e43021fee10877660ece55935850c0cbba977b3cfefc396b430c"} Jul 22 16:22:10.542955 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.542861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" event={"ID":"3b840d49-b814-4370-88bd-a69c3e417866","Type":"ContainerStarted","Data":"1bf6ab92dbe2f9170cf35c2d4e088e0c5e3e96cd3c8bf4fc160312e928e50f2e"} Jul 22 16:22:10.542955 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.542877 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" event={"ID":"3b840d49-b814-4370-88bd-a69c3e417866","Type":"ContainerStarted","Data":"92621899f1617b6f97b8115d4194bf9b5cffdff7f4083e6fda6c6ab65326e831"} Jul 22 16:22:10.559516 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.559470 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64d99b5fd6-sbh4x" podStartSLOduration=3.977608624 podStartE2EDuration="7.5594567s" totalImagesPullingTime="3.581848076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:10.558291226 +0000 UTC m=+67.311227377" watchObservedRunningTime="2026-07-22 16:22:10.5594567 +0000 UTC m=+67.312392840" Jul 22 16:22:10.579508 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:10.579439 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dfc58846b-rzsp5" podStartSLOduration=1.450240452 podStartE2EDuration="8.579417576s" totalImagesPullingTime="7.129177124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:10.577456326 +0000 UTC m=+67.330392467" watchObservedRunningTime="2026-07-22 16:22:10.579417576 +0000 UTC m=+67.332353732" Jul 22 16:22:11.181648 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:11.181609 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:11.282627 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:11.282577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:12.065512 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:12.065472 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ac3a20_6e4d_4f3a_bed1_37320630118b.slice/crio-e2346f32a15f1d5ac78798990ba2d09ce4e977f9976bb1988748e8c18c400d86 WatchSource:0}: Error finding container e2346f32a15f1d5ac78798990ba2d09ce4e977f9976bb1988748e8c18c400d86: Status 404 returned error can't find the container with id e2346f32a15f1d5ac78798990ba2d09ce4e977f9976bb1988748e8c18c400d86 Jul 22 16:22:12.066276 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:12.066244 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf23596_b04b_4214_83f5_3d43d6b907b7.slice/crio-5f601b99577bdad632c7ea4a90ad4a82696f174755ee485114743a5f6781a12e WatchSource:0}: Error finding container 5f601b99577bdad632c7ea4a90ad4a82696f174755ee485114743a5f6781a12e: Status 404 returned error can't find the container with id 5f601b99577bdad632c7ea4a90ad4a82696f174755ee485114743a5f6781a12e Jul 22 16:22:12.552677 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:12.552638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5qd2x" event={"ID":"96ac3a20-6e4d-4f3a-bed1-37320630118b","Type":"ContainerStarted","Data":"e2346f32a15f1d5ac78798990ba2d09ce4e977f9976bb1988748e8c18c400d86"} Jul 22 16:22:12.554582 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:12.554503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4tpzx" event={"ID":"bcf23596-b04b-4214-83f5-3d43d6b907b7","Type":"ContainerStarted","Data":"5f601b99577bdad632c7ea4a90ad4a82696f174755ee485114743a5f6781a12e"} Jul 22 16:22:12.558223 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:12.558164 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffgh6" event={"ID":"d2fb2417-b18e-49c5-82fb-9736e68a5df3","Type":"ContainerStarted","Data":"ccef228bc0bbb6702ae5362e7b9c8de2960ce4651948e9a9ab36ca26422256ac"} Jul 22 16:22:12.587946 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:12.587818 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ffgh6" podStartSLOduration=16.629008429 podStartE2EDuration="32.587770635s" totalImagesPullingTime="15.958762206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:12.583877051 +0000 UTC m=+69.336813205" watchObservedRunningTime="2026-07-22 16:22:12.587770635 +0000 UTC m=+69.340706790" Jul 22 16:22:13.385885 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.385704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:13.444022 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.443976 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:13.510118 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.510011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:13.565993 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.565952 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72lmt" event={"ID":"61dc5eac-5eb0-4285-8558-b077073bb35a","Type":"ContainerStarted","Data":"f029bbf981e007f8b305b97b58d4a51d350d85ada73c23bd5d02ec75eceed26f"} Jul 22 16:22:13.566429 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.566011 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-72lmt" event={"ID":"61dc5eac-5eb0-4285-8558-b077073bb35a","Type":"ContainerStarted","Data":"d74638e4aef1db0abcf6a50906d50211833abe3f1b650a7a53fe2bd8e6a0dca6"} Jul 22 16:22:13.584849 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.584787 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-72lmt" podStartSLOduration=66.63708037 podStartE2EDuration="1m9.584769865s" totalImagesPullingTime="2.947689495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:13.584670049 +0000 UTC m=+70.337606201" watchObservedRunningTime="2026-07-22 16:22:13.584769865 +0000 UTC m=+70.337706012" Jul 22 16:22:13.662222 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.662132 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:13.763459 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.763428 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:13.823653 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:13.823616 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:14.002905 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:14.002864 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:14.003076 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:14.002960 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:14.007712 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:14.007682 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:14.381632 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:14.381530 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:14.574898 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:14.574867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:22:15.880589 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:15.880535 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:15.977662 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:15.977629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.093917 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.093854 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.139855 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.139715 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-md4hb"] Jul 22 16:22:16.144547 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.144451 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.147065 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.146866 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 16:22:16.147065 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.146998 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 16:22:16.147065 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.147040 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pjncw\"" Jul 22 16:22:16.148100 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.148081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 16:22:16.148201 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.148136 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 16:22:16.148289 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.148267 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 16:22:16.148289 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.148090 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 16:22:16.177852 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.177810 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.237145 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd8fd\" (UniqueName: \"kubernetes.io/projected/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-kube-api-access-pd8fd\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-metrics-client-ca\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-wtmp\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-sys\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-textfile\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237544 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-tls\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237544 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237544 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-root\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.237544 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.237461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-accelerators-collector-config\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338464 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-tls\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-root\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-accelerators-collector-config\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd8fd\" (UniqueName: \"kubernetes.io/projected/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-kube-api-access-pd8fd\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-metrics-client-ca\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-wtmp\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-sys\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.338979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.338751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-textfile\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.339153 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.339124 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-textfile\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.339266 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.339227 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-metrics-client-ca\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.339329 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.339281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-wtmp\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.339329 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.339284 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-root\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.339329 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:22:16.339311 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 16:22:16.339473 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.339334 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-sys\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.339473 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:22:16.339370 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-tls podName:da8b0933-3d77-4aa6-bc64-d49ccf649a3f nodeName:}" failed. No retries permitted until 2026-07-22 16:22:16.839350522 +0000 UTC m=+73.592286667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-tls") pod "node-exporter-md4hb" (UID: "da8b0933-3d77-4aa6-bc64-d49ccf649a3f") : secret "node-exporter-tls" not found Jul 22 16:22:16.339725 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.339703 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-accelerators-collector-config\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.342430 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.342405 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.349901 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.349880 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd8fd\" (UniqueName: \"kubernetes.io/projected/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-kube-api-access-pd8fd\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.400184 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.400031 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.501176 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.501132 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.655515 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.655418 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.758344 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.758321 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:16.843916 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.843879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-tls\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:16.846736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:16.846710 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da8b0933-3d77-4aa6-bc64-d49ccf649a3f-node-exporter-tls\") pod \"node-exporter-md4hb\" (UID: \"da8b0933-3d77-4aa6-bc64-d49ccf649a3f\") " pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:17.055757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.055713 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-md4hb" Jul 22 16:22:17.066056 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:17.066027 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8b0933_3d77_4aa6_bc64_d49ccf649a3f.slice/crio-13741a08102fbc3ae3e16910d8537a3924862dfdfa869a609c71868568fdff4c WatchSource:0}: Error finding container 13741a08102fbc3ae3e16910d8537a3924862dfdfa869a609c71868568fdff4c: Status 404 returned error can't find the container with id 13741a08102fbc3ae3e16910d8537a3924862dfdfa869a609c71868568fdff4c Jul 22 16:22:17.119764 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.119732 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:17.209707 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.209672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:17.422359 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.422255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:17.582185 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.582148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5qd2x" event={"ID":"96ac3a20-6e4d-4f3a-bed1-37320630118b","Type":"ContainerStarted","Data":"d16e1f717d9c38750210627a7e204b2a6f296506bc51a622caa3b86ced499ebf"} Jul 22 16:22:17.583783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.583751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4tpzx" event={"ID":"bcf23596-b04b-4214-83f5-3d43d6b907b7","Type":"ContainerStarted","Data":"6d1ae93ff2b124beb2cf024d93d117fde35854011e09a8995d78e77fa20cfc04"} Jul 22 16:22:17.583933 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.583808 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:22:17.584943 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.584924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-md4hb" event={"ID":"da8b0933-3d77-4aa6-bc64-d49ccf649a3f","Type":"ContainerStarted","Data":"13741a08102fbc3ae3e16910d8537a3924862dfdfa869a609c71868568fdff4c"} Jul 22 16:22:17.600918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.600876 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5qd2x" podStartSLOduration=68.962209832 podStartE2EDuration="1m13.600863664s" totalImagesPullingTime="4.638653832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:17.600338512 +0000 UTC m=+74.353274660" watchObservedRunningTime="2026-07-22 16:22:17.600863664 +0000 UTC m=+74.353799810" Jul 22 16:22:17.616676 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:17.616632 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4tpzx" podStartSLOduration=69.021937821 podStartE2EDuration="1m13.616621246s" totalImagesPullingTime="4.594683425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:17.61626084 +0000 UTC m=+74.369196990" watchObservedRunningTime="2026-07-22 16:22:17.616621246 +0000 UTC m=+74.369557395" Jul 22 16:22:19.058933 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:19.058814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:19.115119 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:19.115083 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:19.175644 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:19.175606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:19.414405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:19.414318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:19.593656 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:19.593617 2574 generic.go:356] "Generic (PLEG): container finished" podID="da8b0933-3d77-4aa6-bc64-d49ccf649a3f" containerID="477ba8b1cfe47b714e0316ac4d81d7842887a5eb14bdfc8c978f11ba21d8c088" exitCode=0 Jul 22 16:22:19.593819 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:19.593687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-md4hb" event={"ID":"da8b0933-3d77-4aa6-bc64-d49ccf649a3f","Type":"ContainerDied","Data":"477ba8b1cfe47b714e0316ac4d81d7842887a5eb14bdfc8c978f11ba21d8c088"} Jul 22 16:22:20.003427 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.003389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:20.450085 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.450049 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cfb56b448-l4vrl"] Jul 22 16:22:20.457087 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.457059 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.459979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.459948 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 16:22:20.461116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.461095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-50l2lks3sujm6\"" Jul 22 16:22:20.461231 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.461128 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 16:22:20.461231 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.461131 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 16:22:20.461231 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.461181 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 16:22:20.461365 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.461256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dqjcx\"" Jul 22 16:22:20.469053 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.469031 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cfb56b448-l4vrl"] Jul 22 16:22:20.572565 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/838ab7bf-6649-4185-a7ac-8a3dad9f2632-audit-log\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.572565 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/838ab7bf-6649-4185-a7ac-8a3dad9f2632-metrics-server-audit-profiles\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.572829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lphq8\" (UniqueName: \"kubernetes.io/projected/838ab7bf-6649-4185-a7ac-8a3dad9f2632-kube-api-access-lphq8\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.572829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-secret-metrics-server-tls\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.572829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-client-ca-bundle\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.572829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-secret-metrics-server-client-certs\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.572829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.572811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/838ab7bf-6649-4185-a7ac-8a3dad9f2632-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.599240 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.599206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-md4hb" event={"ID":"da8b0933-3d77-4aa6-bc64-d49ccf649a3f","Type":"ContainerStarted","Data":"ecde544417775d50b48f086484aff483312e9f4bb58d91be1d9921eab85437d0"} Jul 22 16:22:20.599382 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.599256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-md4hb" event={"ID":"da8b0933-3d77-4aa6-bc64-d49ccf649a3f","Type":"ContainerStarted","Data":"30de6ccc6623ad8ebce199910a5689610927a2df6e250eb1ea0c19c4da687a05"} Jul 22 16:22:20.619933 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.619879 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-md4hb" podStartSLOduration=3.063656685 podStartE2EDuration="4.619862601s" totalImagesPullingTime="1.457885205s" totalInitContainerRuntime="98.320711ms" isStatefulPod=true podCreationTimestamp="2026-07-22 16:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:20.618323141 +0000 UTC m=+77.371259328" watchObservedRunningTime="2026-07-22 16:22:20.619862601 +0000 UTC m=+77.372798748" Jul 22 16:22:20.673672 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.673636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/838ab7bf-6649-4185-a7ac-8a3dad9f2632-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.673815 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.673704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/838ab7bf-6649-4185-a7ac-8a3dad9f2632-audit-log\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.673815 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.673727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/838ab7bf-6649-4185-a7ac-8a3dad9f2632-metrics-server-audit-profiles\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.673815 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.673742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lphq8\" (UniqueName: \"kubernetes.io/projected/838ab7bf-6649-4185-a7ac-8a3dad9f2632-kube-api-access-lphq8\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.674202 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.674172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-secret-metrics-server-tls\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.674338 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.674220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-client-ca-bundle\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.674338 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.674231 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/838ab7bf-6649-4185-a7ac-8a3dad9f2632-audit-log\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.674338 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.674255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-secret-metrics-server-client-certs\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.674671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.674646 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/838ab7bf-6649-4185-a7ac-8a3dad9f2632-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.674883 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.674862 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/838ab7bf-6649-4185-a7ac-8a3dad9f2632-metrics-server-audit-profiles\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.676563 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.676533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-secret-metrics-server-tls\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.676696 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.676678 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-client-ca-bundle\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.676754 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.676702 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/838ab7bf-6649-4185-a7ac-8a3dad9f2632-secret-metrics-server-client-certs\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.683658 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.683639 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lphq8\" (UniqueName: \"kubernetes.io/projected/838ab7bf-6649-4185-a7ac-8a3dad9f2632-kube-api-access-lphq8\") pod \"metrics-server-5cfb56b448-l4vrl\" (UID: \"838ab7bf-6649-4185-a7ac-8a3dad9f2632\") " pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.765725 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.765631 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:20.789563 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.789530 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:20.884391 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.884356 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:20.889766 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.889742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cfb56b448-l4vrl"] Jul 22 16:22:20.893438 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:22:20.893413 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838ab7bf_6649_4185_a7ac_8a3dad9f2632.slice/crio-27dcc8bcc81c2231899151df992538bd68be898257f9526db393fa3f07ee8660 WatchSource:0}: Error finding container 27dcc8bcc81c2231899151df992538bd68be898257f9526db393fa3f07ee8660: Status 404 returned error can't find the container with id 27dcc8bcc81c2231899151df992538bd68be898257f9526db393fa3f07ee8660 Jul 22 16:22:20.964242 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:20.964205 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:21.306332 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:21.306304 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:21.607237 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:21.607153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" event={"ID":"838ab7bf-6649-4185-a7ac-8a3dad9f2632","Type":"ContainerStarted","Data":"27dcc8bcc81c2231899151df992538bd68be898257f9526db393fa3f07ee8660"} Jul 22 16:22:22.326718 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:22.326683 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:22.613101 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:22.613018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" event={"ID":"838ab7bf-6649-4185-a7ac-8a3dad9f2632","Type":"ContainerStarted","Data":"2ebfd6f097094bdd5f0d86214c922176f79f4dfa3ec92ce3bd0f827844b22aaa"} Jul 22 16:22:22.634364 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:22.634305 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" podStartSLOduration=1.290692119 podStartE2EDuration="2.634288429s" totalImagesPullingTime="1.34359631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:22:22.632886045 +0000 UTC m=+79.385822196" watchObservedRunningTime="2026-07-22 16:22:22.634288429 +0000 UTC m=+79.387224578" Jul 22 16:22:24.651974 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:24.651944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:24.753297 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:24.753265 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:25.446808 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:25.446767 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:25.505226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:25.505132 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:30.156008 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:30.155969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:30.258674 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:30.258643 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:33.697901 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:33.697858 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:33.799566 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:33.799540 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:35.868377 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:35.868341 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:35.933617 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:35.933586 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:39.046484 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:39.046445 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:39.148418 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:39.148386 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:40.766583 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:40.766545 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:40.767040 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:40.766612 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:22:41.587380 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:41.587349 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d99b5fd6-sbh4x"] Jul 22 16:22:41.692333 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:41.692299 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:41.751950 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:41.751916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:43.393406 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:43.393373 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:43.495284 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:43.495262 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:43.559670 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:43.559634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:47.136673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:47.136644 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:47.226700 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:47.226671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:48.591531 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:48.591498 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4tpzx" Jul 22 16:22:50.883555 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:50.883511 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:50.943968 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:50.943924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:54.720259 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:54.720215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:22:54.782143 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:22:54.782116 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:00.771298 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:00.771267 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:23:00.774909 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:00.774891 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cfb56b448-l4vrl" Jul 22 16:23:06.614504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.614430 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64d99b5fd6-sbh4x" podUID="13d7d1a8-9722-4ca9-9152-7eb41c58d99d" containerName="console" containerID="cri-o://5decade2dbfef81789a325e93eba719414fc1db3ad213e047d77abf79fdec411" gracePeriod=15 Jul 22 16:23:06.761635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.761603 2574 generic.go:356] "Generic (PLEG): container finished" podID="13d7d1a8-9722-4ca9-9152-7eb41c58d99d" containerID="5decade2dbfef81789a325e93eba719414fc1db3ad213e047d77abf79fdec411" exitCode=0 Jul 22 16:23:06.761826 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.761675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d99b5fd6-sbh4x" event={"ID":"13d7d1a8-9722-4ca9-9152-7eb41c58d99d","Type":"ContainerDied","Data":"5decade2dbfef81789a325e93eba719414fc1db3ad213e047d77abf79fdec411"} Jul 22 16:23:06.848936 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.848910 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:23:06.912717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.912631 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-oauth-serving-cert\") pod \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " Jul 22 16:23:06.912717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.912684 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-service-ca\") pod \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " Jul 22 16:23:06.912717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.912710 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-oauth-config\") pod \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " Jul 22 16:23:06.913002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.912731 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz6ng\" (UniqueName: \"kubernetes.io/projected/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-kube-api-access-gz6ng\") pod \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " Jul 22 16:23:06.913002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.912755 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-serving-cert\") pod \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " Jul 22 16:23:06.913002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.912778 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-config\") pod \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\" (UID: \"13d7d1a8-9722-4ca9-9152-7eb41c58d99d\") " Jul 22 16:23:06.913198 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.913169 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13d7d1a8-9722-4ca9-9152-7eb41c58d99d" (UID: "13d7d1a8-9722-4ca9-9152-7eb41c58d99d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:23:06.913247 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.913200 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-service-ca" (OuterVolumeSpecName: "service-ca") pod "13d7d1a8-9722-4ca9-9152-7eb41c58d99d" (UID: "13d7d1a8-9722-4ca9-9152-7eb41c58d99d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:23:06.913284 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.913250 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-config" (OuterVolumeSpecName: "console-config") pod "13d7d1a8-9722-4ca9-9152-7eb41c58d99d" (UID: "13d7d1a8-9722-4ca9-9152-7eb41c58d99d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:23:06.915201 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.915166 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-kube-api-access-gz6ng" (OuterVolumeSpecName: "kube-api-access-gz6ng") pod "13d7d1a8-9722-4ca9-9152-7eb41c58d99d" (UID: "13d7d1a8-9722-4ca9-9152-7eb41c58d99d"). InnerVolumeSpecName "kube-api-access-gz6ng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:23:06.915297 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.915170 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13d7d1a8-9722-4ca9-9152-7eb41c58d99d" (UID: "13d7d1a8-9722-4ca9-9152-7eb41c58d99d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:23:06.915297 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:06.915239 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13d7d1a8-9722-4ca9-9152-7eb41c58d99d" (UID: "13d7d1a8-9722-4ca9-9152-7eb41c58d99d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:23:07.013599 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.013559 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-oauth-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:23:07.013599 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.013592 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz6ng\" (UniqueName: \"kubernetes.io/projected/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-kube-api-access-gz6ng\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:23:07.013599 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.013602 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-serving-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:23:07.013599 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.013611 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-console-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:23:07.013887 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.013620 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-oauth-serving-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:23:07.013887 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.013630 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13d7d1a8-9722-4ca9-9152-7eb41c58d99d-service-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:23:07.766941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.766914 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d99b5fd6-sbh4x" Jul 22 16:23:07.766941 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.766920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d99b5fd6-sbh4x" event={"ID":"13d7d1a8-9722-4ca9-9152-7eb41c58d99d","Type":"ContainerDied","Data":"6cfb42d7c6ee88d4ab29433e978e35d88764a44e5228976b5e213bbbd8f0af44"} Jul 22 16:23:07.767467 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.766977 2574 scope.go:117] "RemoveContainer" containerID="5decade2dbfef81789a325e93eba719414fc1db3ad213e047d77abf79fdec411" Jul 22 16:23:07.790332 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.790301 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d99b5fd6-sbh4x"] Jul 22 16:23:07.794448 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:07.794424 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d99b5fd6-sbh4x"] Jul 22 16:23:08.102849 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:08.102745 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d7d1a8-9722-4ca9-9152-7eb41c58d99d" path="/var/lib/kubelet/pods/13d7d1a8-9722-4ca9-9152-7eb41c58d99d/volumes" Jul 22 16:23:35.346457 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:35.346425 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:35.468022 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:35.467989 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:42.102674 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:42.102641 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:43.566656 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.566619 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6bcc9f5d-dvfft"] Jul 22 16:23:43.567052 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.566900 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d7d1a8-9722-4ca9-9152-7eb41c58d99d" containerName="console" Jul 22 16:23:43.567052 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.566915 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d7d1a8-9722-4ca9-9152-7eb41c58d99d" containerName="console" Jul 22 16:23:43.567052 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.566965 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d7d1a8-9722-4ca9-9152-7eb41c58d99d" containerName="console" Jul 22 16:23:43.569820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.569803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.572664 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.572645 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 16:23:43.572664 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.572651 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 16:23:43.572856 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.572651 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 16:23:43.573707 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.573630 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 16:23:43.573707 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.573634 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 16:23:43.573984 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.573967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 16:23:43.574036 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.573985 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 16:23:43.574036 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.574024 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bmnj5\"" Jul 22 16:23:43.578519 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.578501 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 16:23:43.582276 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.582256 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6bcc9f5d-dvfft"] Jul 22 16:23:43.636568 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.636532 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:43.668489 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-oauth-config\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.668489 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-oauth-serving-cert\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.668691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-console-config\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.668691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-trusted-ca-bundle\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.668691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m8lb\" (UniqueName: \"kubernetes.io/projected/bb76c335-d849-4618-bdf8-d2e3561a1735-kube-api-access-6m8lb\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.668787 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-serving-cert\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.668787 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.668756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-service-ca\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.737196 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.737168 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:43.769326 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-oauth-config\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.769428 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-oauth-serving-cert\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.769428 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-console-config\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.769428 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-trusted-ca-bundle\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.769428 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m8lb\" (UniqueName: \"kubernetes.io/projected/bb76c335-d849-4618-bdf8-d2e3561a1735-kube-api-access-6m8lb\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.769581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-serving-cert\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.769581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.769496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-service-ca\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.770260 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.770238 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-service-ca\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.770372 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.770278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-oauth-serving-cert\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.770372 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.770360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-trusted-ca-bundle\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.770490 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.770360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-console-config\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.772010 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.771984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-oauth-config\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.772085 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.772060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-serving-cert\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.778774 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.778751 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m8lb\" (UniqueName: \"kubernetes.io/projected/bb76c335-d849-4618-bdf8-d2e3561a1735-kube-api-access-6m8lb\") pod \"console-6b6bcc9f5d-dvfft\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:43.838719 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.838629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:43.879350 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:43.879315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:44.014521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:44.014499 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6bcc9f5d-dvfft"] Jul 22 16:23:44.365302 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:44.365264 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:44.466313 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:44.466283 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:44.890882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:44.890828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6bcc9f5d-dvfft" event={"ID":"bb76c335-d849-4618-bdf8-d2e3561a1735","Type":"ContainerStarted","Data":"b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061"} Jul 22 16:23:44.891267 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:44.890896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6bcc9f5d-dvfft" event={"ID":"bb76c335-d849-4618-bdf8-d2e3561a1735","Type":"ContainerStarted","Data":"efda55a86b2749dee4b8f313c24d973f158347c9080fafb0d05ca7965abdf613"} Jul 22 16:23:44.910771 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:44.910687 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6bcc9f5d-dvfft" podStartSLOduration=1.9106687500000001 podStartE2EDuration="1.91066875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:23:44.909583019 +0000 UTC m=+161.662519169" watchObservedRunningTime="2026-07-22 16:23:44.91066875 +0000 UTC m=+161.663605312" Jul 22 16:23:53.879976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:53.879935 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:53.880440 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:53.880035 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:53.884817 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:53.884791 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:53.925194 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:53.925166 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:23:54.088193 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:54.088160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:54.190802 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:54.190775 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:23:54.265717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:23:54.265686 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:17.929878 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:17.929817 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:27.621653 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:27.621620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:27.722543 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:27.722514 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:43.151315 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:43.151285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:50.605098 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:50.605056 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:50.664441 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:50.664411 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:54.743664 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:54.743626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:24:54.845465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:24:54.845430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:02.603532 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:02.603497 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:02.664683 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:02.664656 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:05.201484 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:05.201448 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6bcc9f5d-dvfft"] Jul 22 16:25:05.325321 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:05.325288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:05.393739 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:05.393707 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:05.455698 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:05.455613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:05.880208 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:05.880121 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:05.981264 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:05.981236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:25:30.221253 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.221141 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b6bcc9f5d-dvfft" podUID="bb76c335-d849-4618-bdf8-d2e3561a1735" containerName="console" containerID="cri-o://b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061" gracePeriod=15 Jul 22 16:25:30.459679 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.459652 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:25:30.570301 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570210 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-oauth-serving-cert\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570301 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570248 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-console-config\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570301 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570270 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m8lb\" (UniqueName: \"kubernetes.io/projected/bb76c335-d849-4618-bdf8-d2e3561a1735-kube-api-access-6m8lb\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570301 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570292 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-oauth-config\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570623 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570312 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-serving-cert\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570623 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570332 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-service-ca\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570623 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570435 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-trusted-ca-bundle\") pod \"bb76c335-d849-4618-bdf8-d2e3561a1735\" (UID: \"bb76c335-d849-4618-bdf8-d2e3561a1735\") " Jul 22 16:25:30.570761 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570682 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-console-config" (OuterVolumeSpecName: "console-config") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:30.570867 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570816 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:30.570969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570943 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:30.571031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.570989 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:25:30.572631 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.572603 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb76c335-d849-4618-bdf8-d2e3561a1735-kube-api-access-6m8lb" (OuterVolumeSpecName: "kube-api-access-6m8lb") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "kube-api-access-6m8lb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:25:30.572631 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.572608 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:25:30.572805 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.572626 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb76c335-d849-4618-bdf8-d2e3561a1735" (UID: "bb76c335-d849-4618-bdf8-d2e3561a1735"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:25:30.671205 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671167 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-oauth-serving-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:30.671205 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671200 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-console-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:30.671205 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671211 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m8lb\" (UniqueName: \"kubernetes.io/projected/bb76c335-d849-4618-bdf8-d2e3561a1735-kube-api-access-6m8lb\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:30.671426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671222 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-oauth-config\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:30.671426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671230 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb76c335-d849-4618-bdf8-d2e3561a1735-console-serving-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:30.671426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671238 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-service-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:30.671426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:30.671246 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb76c335-d849-4618-bdf8-d2e3561a1735-trusted-ca-bundle\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:25:31.241288 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.241252 2574 generic.go:356] "Generic (PLEG): container finished" podID="bb76c335-d849-4618-bdf8-d2e3561a1735" containerID="b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061" exitCode=0 Jul 22 16:25:31.241738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.241302 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6bcc9f5d-dvfft" Jul 22 16:25:31.241738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.241303 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6bcc9f5d-dvfft" event={"ID":"bb76c335-d849-4618-bdf8-d2e3561a1735","Type":"ContainerDied","Data":"b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061"} Jul 22 16:25:31.241738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.241425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6bcc9f5d-dvfft" event={"ID":"bb76c335-d849-4618-bdf8-d2e3561a1735","Type":"ContainerDied","Data":"efda55a86b2749dee4b8f313c24d973f158347c9080fafb0d05ca7965abdf613"} Jul 22 16:25:31.241738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.241451 2574 scope.go:117] "RemoveContainer" containerID="b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061" Jul 22 16:25:31.250116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.250101 2574 scope.go:117] "RemoveContainer" containerID="b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061" Jul 22 16:25:31.250347 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:25:31.250331 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061\": container with ID starting with b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061 not found: ID does not exist" containerID="b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061" Jul 22 16:25:31.250384 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.250354 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061"} err="failed to get container status \"b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061\": rpc error: code = NotFound desc = could not find container \"b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061\": container with ID starting with b5b640a1be4cfacdb6eea8221bccf7a6d92e85df0d52e0b974ff8e0fd927f061 not found: ID does not exist" Jul 22 16:25:31.264849 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.264815 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6bcc9f5d-dvfft"] Jul 22 16:25:31.268590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:31.268571 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6bcc9f5d-dvfft"] Jul 22 16:25:32.103468 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:25:32.103434 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb76c335-d849-4618-bdf8-d2e3561a1735" path="/var/lib/kubelet/pods/bb76c335-d849-4618-bdf8-d2e3561a1735/volumes" Jul 22 16:26:03.564969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:26:03.564937 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 16:26:18.884352 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:26:18.884314 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:26:41.853287 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:26:41.853251 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:26:41.953265 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:26:41.953218 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:00.451226 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:00.451149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:08.511369 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:08.511335 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:09.505634 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:09.505598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:12.329210 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:12.329174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:12.387691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:12.387657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:13.989228 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:13.989198 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:14.110231 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:14.110201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:14.218222 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:14.218189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:16.138222 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:16.138190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:16.761633 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:16.761600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:19.113714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:19.113682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:19.176691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:19.176667 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:24.743068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:24.743030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:25.514720 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:25.514676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:25.616008 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:25.615953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:27.570690 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.570653 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff"] Jul 22 16:27:27.571188 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.571016 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb76c335-d849-4618-bdf8-d2e3561a1735" containerName="console" Jul 22 16:27:27.571188 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.571034 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb76c335-d849-4618-bdf8-d2e3561a1735" containerName="console" Jul 22 16:27:27.571188 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.571108 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb76c335-d849-4618-bdf8-d2e3561a1735" containerName="console" Jul 22 16:27:27.573825 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.573805 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.576709 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.576686 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 16:27:27.577702 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.577680 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 16:27:27.577790 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.577683 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-k6kf5\"" Jul 22 16:27:27.582868 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.582848 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff"] Jul 22 16:27:27.691608 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.691566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d4efc-f94d-47b6-8554-3444ba031a0b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dm7ff\" (UID: \"e93d4efc-f94d-47b6-8554-3444ba031a0b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.691608 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.691609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scxpk\" (UniqueName: \"kubernetes.io/projected/e93d4efc-f94d-47b6-8554-3444ba031a0b-kube-api-access-scxpk\") pod \"openshift-lws-operator-fd8ccff4c-dm7ff\" (UID: \"e93d4efc-f94d-47b6-8554-3444ba031a0b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.792989 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.792951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d4efc-f94d-47b6-8554-3444ba031a0b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dm7ff\" (UID: \"e93d4efc-f94d-47b6-8554-3444ba031a0b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.792989 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.792992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxpk\" (UniqueName: \"kubernetes.io/projected/e93d4efc-f94d-47b6-8554-3444ba031a0b-kube-api-access-scxpk\") pod \"openshift-lws-operator-fd8ccff4c-dm7ff\" (UID: \"e93d4efc-f94d-47b6-8554-3444ba031a0b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.793337 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.793317 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d4efc-f94d-47b6-8554-3444ba031a0b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dm7ff\" (UID: \"e93d4efc-f94d-47b6-8554-3444ba031a0b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.802383 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.802351 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scxpk\" (UniqueName: \"kubernetes.io/projected/e93d4efc-f94d-47b6-8554-3444ba031a0b-kube-api-access-scxpk\") pod \"openshift-lws-operator-fd8ccff4c-dm7ff\" (UID: \"e93d4efc-f94d-47b6-8554-3444ba031a0b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:27.882479 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:27.882394 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" Jul 22 16:27:28.007586 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:28.007559 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff"] Jul 22 16:27:28.009891 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:27:28.009863 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode93d4efc_f94d_47b6_8554_3444ba031a0b.slice/crio-4dd0ac34587bc86f3451a64d51849e8f3d0bb5f6de815e1c3c8411f27305c19a WatchSource:0}: Error finding container 4dd0ac34587bc86f3451a64d51849e8f3d0bb5f6de815e1c3c8411f27305c19a: Status 404 returned error can't find the container with id 4dd0ac34587bc86f3451a64d51849e8f3d0bb5f6de815e1c3c8411f27305c19a Jul 22 16:27:28.011286 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:28.011271 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:27:28.615417 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:28.615381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" event={"ID":"e93d4efc-f94d-47b6-8554-3444ba031a0b","Type":"ContainerStarted","Data":"4dd0ac34587bc86f3451a64d51849e8f3d0bb5f6de815e1c3c8411f27305c19a"} Jul 22 16:27:31.626795 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:31.626756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" event={"ID":"e93d4efc-f94d-47b6-8554-3444ba031a0b","Type":"ContainerStarted","Data":"5c56006d2774cb0fc1c6833f1a4205cea58457b95067b7b023c2db11139204a6"} Jul 22 16:27:31.645126 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:31.645077 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dm7ff" podStartSLOduration=2.046534864 podStartE2EDuration="4.645063219s" totalImagesPullingTime="2.598528355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:31.644237881 +0000 UTC m=+388.397174034" watchObservedRunningTime="2026-07-22 16:27:31.645063219 +0000 UTC m=+388.397999370" Jul 22 16:27:32.500782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:32.500744 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:32.604272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:32.604245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:34.458259 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:34.458225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:46.733915 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:46.733878 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:46.841534 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:46.841499 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:47.326961 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.326926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:47.575798 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.575767 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:47.678852 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.678758 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:47.683825 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.683796 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh"] Jul 22 16:27:47.687276 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.687251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.691203 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.691184 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 16:27:47.691203 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.691196 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 16:27:47.691384 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.691184 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 16:27:47.691384 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.691371 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 16:27:47.691567 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.691551 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxznl\"" Jul 22 16:27:47.703289 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.703255 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh"] Jul 22 16:27:47.827058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.827031 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:47.839162 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.839129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.839294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.839190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-tmp\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.839294 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.839248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-manifests\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.839365 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.839298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd2sd\" (UniqueName: \"kubernetes.io/projected/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-kube-api-access-xd2sd\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.839365 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.839337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.927133 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.927103 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:47.940207 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.940177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd2sd\" (UniqueName: \"kubernetes.io/projected/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-kube-api-access-xd2sd\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.940306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.940226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.940306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.940267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.940408 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.940303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-tmp\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.940512 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.940491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-manifests\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.940860 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.940817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-manifests\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.942537 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.942515 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-tmp\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.942931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.942911 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.943003 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.942915 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.958249 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.958215 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd2sd\" (UniqueName: \"kubernetes.io/projected/ee016641-9aa0-4ebf-a5c2-8fee04ed8bec-kube-api-access-xd2sd\") pod \"opendatahub-operator-controller-manager-6cb6494f8-s5lgh\" (UID: \"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:47.997295 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:47.997253 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:48.030770 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:48.030741 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:48.138865 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:48.138671 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh"] Jul 22 16:27:48.139642 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:48.139621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:48.141657 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:27:48.141633 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee016641_9aa0_4ebf_a5c2_8fee04ed8bec.slice/crio-52c749b0ca1873b28ba89f4ed623d12affd731c4333b9c9a3cef8710011ad0ab WatchSource:0}: Error finding container 52c749b0ca1873b28ba89f4ed623d12affd731c4333b9c9a3cef8710011ad0ab: Status 404 returned error can't find the container with id 52c749b0ca1873b28ba89f4ed623d12affd731c4333b9c9a3cef8710011ad0ab Jul 22 16:27:48.229583 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:48.229497 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:48.685409 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:48.685377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" event={"ID":"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec","Type":"ContainerStarted","Data":"52c749b0ca1873b28ba89f4ed623d12affd731c4333b9c9a3cef8710011ad0ab"} Jul 22 16:27:51.699174 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:51.699141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" event={"ID":"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec","Type":"ContainerStarted","Data":"835a63aa7a0fecab8fb569a7e54091768cb16eb53bcd19e3fc5e539856f3e3e1"} Jul 22 16:27:51.825670 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:51.825631 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:51.917359 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:51.917327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:27:52.703894 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:52.703826 2574 generic.go:356] "Generic (PLEG): container finished" podID="ee016641-9aa0-4ebf-a5c2-8fee04ed8bec" containerID="835a63aa7a0fecab8fb569a7e54091768cb16eb53bcd19e3fc5e539856f3e3e1" exitCode=0 Jul 22 16:27:52.703894 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:52.703881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" event={"ID":"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec","Type":"ContainerDied","Data":"835a63aa7a0fecab8fb569a7e54091768cb16eb53bcd19e3fc5e539856f3e3e1"} Jul 22 16:27:53.708377 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:53.708339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" event={"ID":"ee016641-9aa0-4ebf-a5c2-8fee04ed8bec","Type":"ContainerStarted","Data":"29c9b20915ce4957934e3f1e1bbe80e50f232c28fd36debae28e2bd8d1e0b85a"} Jul 22 16:27:53.708755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:53.708421 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:27:53.734724 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:27:53.734659 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" podStartSLOduration=2.301024385 podStartE2EDuration="6.734637423s" totalImagesPullingTime="3.393928004s" totalInitContainerRuntime="1.039685034s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:27:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:27:53.733295794 +0000 UTC m=+410.486231981" watchObservedRunningTime="2026-07-22 16:27:53.734637423 +0000 UTC m=+410.487573573" Jul 22 16:28:02.970420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:02.970371 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:03.073781 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:03.073749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:04.714181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:04.714151 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cb6494f8-s5lgh" Jul 22 16:28:04.955692 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:04.955653 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6"] Jul 22 16:28:05.077011 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.076928 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6"] Jul 22 16:28:05.077157 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.077043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.080259 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.080230 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cz4dk\"" Jul 22 16:28:05.080405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.080263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 16:28:05.080405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.080270 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 16:28:05.080405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.080268 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 16:28:05.164765 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.164728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-cert\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.164765 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.164768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-manager-config\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.165001 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.164788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw54j\" (UniqueName: \"kubernetes.io/projected/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-kube-api-access-lw54j\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.165001 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.164921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-metrics-cert\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.265562 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.265523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-cert\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.265765 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.265570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-manager-config\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.265765 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.265604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw54j\" (UniqueName: \"kubernetes.io/projected/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-kube-api-access-lw54j\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.265765 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.265665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-metrics-cert\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.266332 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.266304 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-manager-config\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.268109 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.268090 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-metrics-cert\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.268181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.268136 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-cert\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.274925 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.274904 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw54j\" (UniqueName: \"kubernetes.io/projected/0a942ca9-6c51-4478-bef8-0a6aef4c70ec-kube-api-access-lw54j\") pod \"lws-controller-manager-66c589788b-9z6l6\" (UID: \"0a942ca9-6c51-4478-bef8-0a6aef4c70ec\") " pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.386469 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.386387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:05.527465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.527422 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6"] Jul 22 16:28:05.530015 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:28:05.529986 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a942ca9_6c51_4478_bef8_0a6aef4c70ec.slice/crio-24ef93c3d8653393e71df5869fac20215c68628acfa73bc63db06140c264b183 WatchSource:0}: Error finding container 24ef93c3d8653393e71df5869fac20215c68628acfa73bc63db06140c264b183: Status 404 returned error can't find the container with id 24ef93c3d8653393e71df5869fac20215c68628acfa73bc63db06140c264b183 Jul 22 16:28:05.749951 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:05.749912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" event={"ID":"0a942ca9-6c51-4478-bef8-0a6aef4c70ec","Type":"ContainerStarted","Data":"24ef93c3d8653393e71df5869fac20215c68628acfa73bc63db06140c264b183"} Jul 22 16:28:06.982982 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:06.982950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:07.098332 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.098298 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:07.448105 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.448038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:07.691017 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.690984 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:07.760018 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.759931 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" event={"ID":"0a942ca9-6c51-4478-bef8-0a6aef4c70ec","Type":"ContainerStarted","Data":"44a377c64d937c7236974faa242596b7822428e9257ad71562801a8f9d2510ba"} Jul 22 16:28:07.760190 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.760052 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:07.781466 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.781408 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" podStartSLOduration=2.410943624 podStartE2EDuration="3.781387185s" totalImagesPullingTime="1.370443561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:07.779929615 +0000 UTC m=+424.532865766" watchObservedRunningTime="2026-07-22 16:28:07.781387185 +0000 UTC m=+424.534323335" Jul 22 16:28:07.784611 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.784589 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:07.882457 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:07.882405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:08.099655 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:08.099574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:08.231252 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:08.231220 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:08.333927 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:08.333890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:08.972449 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:08.972413 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:09.124443 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:09.124401 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:10.024215 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:10.024176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:14.456487 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:14.456440 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:14.558787 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:14.558758 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:15.364039 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.364005 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg"] Jul 22 16:28:15.368341 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.368315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.371378 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.371349 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2jrfz\"" Jul 22 16:28:15.371504 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.371357 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 16:28:15.371564 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.371538 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 16:28:15.372810 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.372786 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 16:28:15.384880 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.384816 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg"] Jul 22 16:28:15.407095 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.407057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:15.449451 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449409 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449451 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be5b6faa-722c-45a4-8636-c6f37c42a352-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449663 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449663 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449663 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449521 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449663 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449663 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449817 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcnsq\" (UniqueName: \"kubernetes.io/projected/be5b6faa-722c-45a4-8636-c6f37c42a352-kube-api-access-zcnsq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.449817 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.449693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.465978 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.465947 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w"] Jul 22 16:28:15.469241 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.469214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.472318 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.472290 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 16:28:15.472318 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.472304 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8m4ks\"" Jul 22 16:28:15.472318 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.472293 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 16:28:15.472552 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.472307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 16:28:15.485498 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.485463 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w"] Jul 22 16:28:15.550560 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.550736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.550736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be5b6faa-722c-45a4-8636-c6f37c42a352-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.550736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.550736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.550736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.550736 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.551061 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.551061 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.550761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f33ace9-cbe1-4643-8d03-e3161e077bff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.551061 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551061 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.551245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551135 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnsq\" (UniqueName: \"kubernetes.io/projected/be5b6faa-722c-45a4-8636-c6f37c42a352-kube-api-access-zcnsq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.551245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551500 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cv2\" (UniqueName: \"kubernetes.io/projected/8f33ace9-cbe1-4643-8d03-e3161e077bff-kube-api-access-g6cv2\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.551500 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551462 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be5b6faa-722c-45a4-8636-c6f37c42a352-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551500 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551481 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.551803 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.551745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.553559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.553539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.553654 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.553587 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.562936 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.562908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be5b6faa-722c-45a4-8636-c6f37c42a352-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.570111 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.570085 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnsq\" (UniqueName: \"kubernetes.io/projected/be5b6faa-722c-45a4-8636-c6f37c42a352-kube-api-access-zcnsq\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789t6xg\" (UID: \"be5b6faa-722c-45a4-8636-c6f37c42a352\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.651747 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.651747 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.651747 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cv2\" (UniqueName: \"kubernetes.io/projected/8f33ace9-cbe1-4643-8d03-e3161e077bff-kube-api-access-g6cv2\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.651747 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.652116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.652116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.652116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.651867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f33ace9-cbe1-4643-8d03-e3161e077bff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.652441 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.652411 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.654225 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.654203 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.654347 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.654312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.654469 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.654454 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f33ace9-cbe1-4643-8d03-e3161e077bff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.654603 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.654585 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f33ace9-cbe1-4643-8d03-e3161e077bff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.662435 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.662409 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cv2\" (UniqueName: \"kubernetes.io/projected/8f33ace9-cbe1-4643-8d03-e3161e077bff-kube-api-access-g6cv2\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.664082 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.664061 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f33ace9-cbe1-4643-8d03-e3161e077bff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rxh6w\" (UID: \"8f33ace9-cbe1-4643-8d03-e3161e077bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.679541 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.679507 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:15.709776 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.709746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:15.779297 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.779258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:15.818366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.818139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:15.825893 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.825857 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg"] Jul 22 16:28:15.830185 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:28:15.830156 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5b6faa_722c_45a4_8636_c6f37c42a352.slice/crio-8b2a079016f7055a7582e8c20b638ed18be24fab37c9222772cf2c4f156da26e WatchSource:0}: Error finding container 8b2a079016f7055a7582e8c20b638ed18be24fab37c9222772cf2c4f156da26e: Status 404 returned error can't find the container with id 8b2a079016f7055a7582e8c20b638ed18be24fab37c9222772cf2c4f156da26e Jul 22 16:28:15.940671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:15.940641 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w"] Jul 22 16:28:15.943873 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:28:15.943844 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f33ace9_cbe1_4643_8d03_e3161e077bff.slice/crio-ebac40406f7ffcbd40776833989290b954e7b948d958539f70e2c65bb584563b WatchSource:0}: Error finding container ebac40406f7ffcbd40776833989290b954e7b948d958539f70e2c65bb584563b: Status 404 returned error can't find the container with id ebac40406f7ffcbd40776833989290b954e7b948d958539f70e2c65bb584563b Jul 22 16:28:16.799059 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:16.799016 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" event={"ID":"8f33ace9-cbe1-4643-8d03-e3161e077bff","Type":"ContainerStarted","Data":"ebac40406f7ffcbd40776833989290b954e7b948d958539f70e2c65bb584563b"} Jul 22 16:28:16.801455 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:16.801426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" event={"ID":"be5b6faa-722c-45a4-8636-c6f37c42a352","Type":"ContainerStarted","Data":"8b2a079016f7055a7582e8c20b638ed18be24fab37c9222772cf2c4f156da26e"} Jul 22 16:28:18.331859 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:18.325659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:18.429817 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:18.428763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:18.631128 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:18.630996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:18.765827 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:18.765797 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66c589788b-9z6l6" Jul 22 16:28:18.768250 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:18.768226 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:19.615412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.615361 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:19.734019 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.733977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:19.811461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.811433 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:19.861072 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.861020 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:19.861181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.861107 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:19.863649 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.863621 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:19.863719 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.863694 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:19.863755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:19.863729 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:28:20.825901 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:20.825851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" event={"ID":"be5b6faa-722c-45a4-8636-c6f37c42a352","Type":"ContainerStarted","Data":"c4ab73b012b0d9992df6b6f4489eb135c26241a69a422c87ce472ca0ba3f4127"} Jul 22 16:28:20.827330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:20.827306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" event={"ID":"8f33ace9-cbe1-4643-8d03-e3161e077bff","Type":"ContainerStarted","Data":"8337d3abc99a739548ac50edff431ed0287c60016a82fcc7f08e4d32a7e35e60"} Jul 22 16:28:20.827521 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:20.827503 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:20.829097 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:20.829080 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" Jul 22 16:28:20.866165 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:20.866116 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" podStartSLOduration=1.836435674 podStartE2EDuration="5.866102387s" totalImagesPullingTime="4.029666713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:20.862498933 +0000 UTC m=+437.615435082" watchObservedRunningTime="2026-07-22 16:28:20.866102387 +0000 UTC m=+437.619038596" Jul 22 16:28:20.922630 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:20.922561 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rxh6w" podStartSLOduration=2.008123142 podStartE2EDuration="5.922537019s" totalImagesPullingTime="3.914413877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:28:20.912120864 +0000 UTC m=+437.665057014" watchObservedRunningTime="2026-07-22 16:28:20.922537019 +0000 UTC m=+437.675473170" Jul 22 16:28:21.679717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:21.679668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:21.684685 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:21.684652 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:21.831801 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:21.831766 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:21.832699 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:21.832676 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789t6xg" Jul 22 16:28:44.022800 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:44.022724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:55.394847 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:55.394814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:55.496573 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:55.496534 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:55.560309 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:55.560278 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:58.741606 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:58.741570 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:28:58.841992 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:28:58.841948 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:08.778220 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:08.778171 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:08.883236 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:08.883202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:09.012669 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:09.012638 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:09.759534 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:09.759498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:09.956673 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:09.956633 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:31.691038 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:31.691004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:35.295418 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:35.295384 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:37.446030 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:37.445992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:39.247632 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:39.247597 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:39.653091 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:39.653019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:41.132073 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:41.132033 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:42.669648 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:42.669613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:43.542165 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:43.542125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:43.687078 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:43.687013 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:45.483976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:45.483934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:45.698649 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:45.698619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:45.926330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:45.926250 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:47.458799 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:47.458769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:47.535628 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:47.535588 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:54.481975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:54.481925 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:54.586970 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:54.586922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:54.896487 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:54.896396 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:55.001554 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:55.001511 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:59.681115 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:59.681034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:29:59.787930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:29:59.787887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:02.113753 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:02.113724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:02.177679 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:02.177632 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:07.730049 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:07.730007 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:07.828277 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:07.828245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:14.659172 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:14.659133 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:14.785172 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:14.785142 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:19.442931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:19.442897 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:19.555691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:19.555655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:21.946792 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:21.946757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:22.061390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:22.061360 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:26.759153 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.759117 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g"] Jul 22 16:30:26.762255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.762231 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.765110 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.765086 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rjhvp\"" Jul 22 16:30:26.776505 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.776475 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g"] Jul 22 16:30:26.792658 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.792637 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:26.813262 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6lcp\" (UniqueName: \"kubernetes.io/projected/3d69805f-7b44-4ac9-973f-e3e52d8358c6-kube-api-access-s6lcp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.813581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.813505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6lcp\" (UniqueName: \"kubernetes.io/projected/3d69805f-7b44-4ac9-973f-e3e52d8358c6-kube-api-access-s6lcp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914728 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914810 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914777 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.914968 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914953 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.915033 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.914981 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.915076 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.915060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.916640 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.916614 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.916873 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.916854 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.923282 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.923258 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d69805f-7b44-4ac9-973f-e3e52d8358c6-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:26.923362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:26.923334 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6lcp\" (UniqueName: \"kubernetes.io/projected/3d69805f-7b44-4ac9-973f-e3e52d8358c6-kube-api-access-s6lcp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xkn7g\" (UID: \"3d69805f-7b44-4ac9-973f-e3e52d8358c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:27.073039 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.072938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:27.214341 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.214311 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g"] Jul 22 16:30:27.216676 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:30:27.216651 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d69805f_7b44_4ac9_973f_e3e52d8358c6.slice/crio-29d85c7f66f0564174d1a622518a4263539468c101e289fa8528010884648655 WatchSource:0}: Error finding container 29d85c7f66f0564174d1a622518a4263539468c101e289fa8528010884648655: Status 404 returned error can't find the container with id 29d85c7f66f0564174d1a622518a4263539468c101e289fa8528010884648655 Jul 22 16:30:27.218799 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.218759 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:30:27.218880 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.218859 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:30:27.218919 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.218904 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:30:27.236215 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.236191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:27.313653 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.313608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" event={"ID":"3d69805f-7b44-4ac9-973f-e3e52d8358c6","Type":"ContainerStarted","Data":"b17b925732501b5ae61627576dac81d7cd4a800b8313e74033daf1155a09f812"} Jul 22 16:30:27.313827 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.313676 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" event={"ID":"3d69805f-7b44-4ac9-973f-e3e52d8358c6","Type":"ContainerStarted","Data":"29d85c7f66f0564174d1a622518a4263539468c101e289fa8528010884648655"} Jul 22 16:30:27.335218 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.335110 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" podStartSLOduration=1.335095709 podStartE2EDuration="1.335095709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:30:27.333428477 +0000 UTC m=+564.086364630" watchObservedRunningTime="2026-07-22 16:30:27.335095709 +0000 UTC m=+564.088031917" Jul 22 16:30:27.835132 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.835084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:27.900798 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:27.900750 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:28.073170 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.073127 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:28.078224 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.078197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:28.317717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.317679 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:28.318586 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.318560 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:30:28.673491 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.673409 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:28.772284 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.772250 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:28.837611 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:28.837576 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:29.726760 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:29.726727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:29.823291 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:29.823256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:35.042449 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:35.042413 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:35.139246 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:35.139216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:39.848476 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:39.848439 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:39.946405 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:39.946373 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:42.296969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:42.296934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:42.355624 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:42.355595 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:50.054920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:50.054885 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:50.157173 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:50.157137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:30:50.629704 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:30:50.629672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:02.444790 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:02.444755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:02.664754 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:02.664718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:04.369339 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:04.369302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:04.469883 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:04.469827 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:11.706582 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:11.706546 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:11.806042 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:11.806008 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:11.868849 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:11.868815 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:12.018911 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:12.018810 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:15.402240 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:15.402204 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:15.495991 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:15.495967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:17.462066 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:17.462035 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:46.958636 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:46.958601 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:48.174940 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.174908 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:48.191728 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.191694 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4cqhk"] Jul 22 16:31:48.194830 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.194809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.197470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.197448 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 16:31:48.197744 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.197723 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9wf4v\"" Jul 22 16:31:48.204606 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.204581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4cqhk"] Jul 22 16:31:48.298463 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.298433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6txr\" (UniqueName: \"kubernetes.io/projected/bb045d52-53ac-4501-926c-36813ce1e58a-kube-api-access-m6txr\") pod \"payload-processing-5bf47cd988-4cqhk\" (UID: \"bb045d52-53ac-4501-926c-36813ce1e58a\") " pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.298621 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.298496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb045d52-53ac-4501-926c-36813ce1e58a-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4cqhk\" (UID: \"bb045d52-53ac-4501-926c-36813ce1e58a\") " pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.399958 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.399925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6txr\" (UniqueName: \"kubernetes.io/projected/bb045d52-53ac-4501-926c-36813ce1e58a-kube-api-access-m6txr\") pod \"payload-processing-5bf47cd988-4cqhk\" (UID: \"bb045d52-53ac-4501-926c-36813ce1e58a\") " pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.400130 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.399984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb045d52-53ac-4501-926c-36813ce1e58a-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4cqhk\" (UID: \"bb045d52-53ac-4501-926c-36813ce1e58a\") " pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.400671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.400651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb045d52-53ac-4501-926c-36813ce1e58a-plugins-config-volume\") pod \"payload-processing-5bf47cd988-4cqhk\" (UID: \"bb045d52-53ac-4501-926c-36813ce1e58a\") " pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.410613 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.410587 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6txr\" (UniqueName: \"kubernetes.io/projected/bb045d52-53ac-4501-926c-36813ce1e58a-kube-api-access-m6txr\") pod \"payload-processing-5bf47cd988-4cqhk\" (UID: \"bb045d52-53ac-4501-926c-36813ce1e58a\") " pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.506546 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.506502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:48.640902 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:48.640826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-4cqhk"] Jul 22 16:31:48.643087 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:31:48.643063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb045d52_53ac_4501_926c_36813ce1e58a.slice/crio-68ee6b291aac51b63ea9c39e5bf3b92023df96fb4aff5e3c14b8cd6380af8371 WatchSource:0}: Error finding container 68ee6b291aac51b63ea9c39e5bf3b92023df96fb4aff5e3c14b8cd6380af8371: Status 404 returned error can't find the container with id 68ee6b291aac51b63ea9c39e5bf3b92023df96fb4aff5e3c14b8cd6380af8371 Jul 22 16:31:49.654220 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:49.654181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" event={"ID":"bb045d52-53ac-4501-926c-36813ce1e58a","Type":"ContainerStarted","Data":"68ee6b291aac51b63ea9c39e5bf3b92023df96fb4aff5e3c14b8cd6380af8371"} Jul 22 16:31:51.665696 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:51.665601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" event={"ID":"bb045d52-53ac-4501-926c-36813ce1e58a","Type":"ContainerStarted","Data":"af4e325cbe62e2f3e334a1bb58c7c17412b7cd2445f1056121c1e070b9722c37"} Jul 22 16:31:51.666330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:51.666281 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:31:51.688827 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:51.688774 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" podStartSLOduration=0.977166854 podStartE2EDuration="3.68875856s" totalImagesPullingTime="2.711591706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:31:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:31:51.687205164 +0000 UTC m=+648.440141314" watchObservedRunningTime="2026-07-22 16:31:51.68875856 +0000 UTC m=+648.441694710" Jul 22 16:31:51.738652 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:51.738610 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:51.839382 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:51.839351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:55.683651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:55.683618 2574 generic.go:356] "Generic (PLEG): container finished" podID="3d69805f-7b44-4ac9-973f-e3e52d8358c6" containerID="b17b925732501b5ae61627576dac81d7cd4a800b8313e74033daf1155a09f812" exitCode=0 Jul 22 16:31:55.684172 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:55.683672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" event={"ID":"3d69805f-7b44-4ac9-973f-e3e52d8358c6","Type":"ContainerDied","Data":"b17b925732501b5ae61627576dac81d7cd4a800b8313e74033daf1155a09f812"} Jul 22 16:31:55.684172 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:55.684019 2574 scope.go:117] "RemoveContainer" containerID="b17b925732501b5ae61627576dac81d7cd4a800b8313e74033daf1155a09f812" Jul 22 16:31:55.684991 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:55.684963 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:31:55.685094 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:55.685028 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:31:55.685094 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:55.685060 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:31:56.689402 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:56.689365 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" event={"ID":"3d69805f-7b44-4ac9-973f-e3e52d8358c6","Type":"ContainerStarted","Data":"989ec21b190dd8b39992c988e2fbff1815484895bb3c648e7fb6ba8ed6ecbb7c"} Jul 22 16:31:57.073907 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:57.073785 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:31:57.074967 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:57.074931 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xkn7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 22 16:31:57.075029 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:57.074993 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" podUID="3d69805f-7b44-4ac9-973f-e3e52d8358c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 22 16:31:58.073454 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:58.073410 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xkn7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 22 16:31:58.073893 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:58.073483 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" podUID="3d69805f-7b44-4ac9-973f-e3e52d8358c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 22 16:31:58.318415 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:58.318375 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:31:58.431309 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:58.431279 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:58.530274 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:58.530233 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:58.728251 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:58.728170 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:31:59.073717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:59.073632 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xkn7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 22 16:31:59.073717 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:31:59.073686 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" podUID="3d69805f-7b44-4ac9-973f-e3e52d8358c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 22 16:32:00.073928 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:00.073893 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xkn7g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 22 16:32:00.074326 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:00.073962 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" podUID="3d69805f-7b44-4ac9-973f-e3e52d8358c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 22 16:32:01.077558 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:01.077523 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:32:01.078715 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:01.078697 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xkn7g" Jul 22 16:32:03.675023 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:03.674990 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-4cqhk" Jul 22 16:32:07.523901 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:07.523868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:16.415814 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:16.415775 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:25.293955 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.293923 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn"] Jul 22 16:32:25.297689 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.297666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.301398 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.301370 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 16:32:25.301502 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.301405 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 16:32:25.301502 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.301458 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b2274\"" Jul 22 16:32:25.301584 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.301370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 16:32:25.309621 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.309595 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn"] Jul 22 16:32:25.332730 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.332700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:25.433926 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.433827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.434116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.433941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.434116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.434064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2166c70-c730-4ca8-91a0-624af1c51075-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.434116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.434100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.434221 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.434130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl69k\" (UniqueName: \"kubernetes.io/projected/b2166c70-c730-4ca8-91a0-624af1c51075-kube-api-access-nl69k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.434221 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.434168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535425 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535425 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2166c70-c730-4ca8-91a0-624af1c51075-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl69k\" (UniqueName: \"kubernetes.io/projected/b2166c70-c730-4ca8-91a0-624af1c51075-kube-api-access-nl69k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535907 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535885 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.535963 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.535925 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.536025 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.536002 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.537884 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.537861 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2166c70-c730-4ca8-91a0-624af1c51075-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.538169 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.538147 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2166c70-c730-4ca8-91a0-624af1c51075-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.544931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.544875 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl69k\" (UniqueName: \"kubernetes.io/projected/b2166c70-c730-4ca8-91a0-624af1c51075-kube-api-access-nl69k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8b7gn\" (UID: \"b2166c70-c730-4ca8-91a0-624af1c51075\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.608919 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.608860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:25.746689 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.746540 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn"] Jul 22 16:32:25.749062 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:32:25.749030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2166c70_c730_4ca8_91a0_624af1c51075.slice/crio-c10a1fa47de57c6f1efbc70892823cb238a2a435dda87087ffc01b3509434629 WatchSource:0}: Error finding container c10a1fa47de57c6f1efbc70892823cb238a2a435dda87087ffc01b3509434629: Status 404 returned error can't find the container with id c10a1fa47de57c6f1efbc70892823cb238a2a435dda87087ffc01b3509434629 Jul 22 16:32:25.804143 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:25.804043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" event={"ID":"b2166c70-c730-4ca8-91a0-624af1c51075","Type":"ContainerStarted","Data":"c10a1fa47de57c6f1efbc70892823cb238a2a435dda87087ffc01b3509434629"} Jul 22 16:32:26.810064 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:26.810029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" event={"ID":"b2166c70-c730-4ca8-91a0-624af1c51075","Type":"ContainerStarted","Data":"0993d9f3a96c2348a9b4d52e3f1c31a56ae88c0b7df3c09a978611af4c204c66"} Jul 22 16:32:26.836420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:26.836368 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" podStartSLOduration=0.866182853 podStartE2EDuration="1.836351782s" totalImagesPullingTime="970.168929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:32:26.835373787 +0000 UTC m=+683.588309936" watchObservedRunningTime="2026-07-22 16:32:26.836351782 +0000 UTC m=+683.589287933" Jul 22 16:32:28.881138 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:28.881107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:28.945035 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:28.945009 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:35.609468 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:35.609428 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:35.609930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:35.609499 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:35.621771 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:35.621740 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:35.856814 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:35.856782 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8b7gn" Jul 22 16:32:39.114432 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:39.114395 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:44.218652 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:44.218609 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:32:53.624220 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:32:53.624188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:33:14.745553 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:33:14.745501 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:34:19.964734 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:34:19.964698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:34:29.793972 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:34:29.793876 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:34:29.913000 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:34:29.912964 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:34:31.115910 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:34:31.115878 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:34:31.210631 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:34:31.210596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:35:52.539517 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:35:52.539486 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:36:20.576514 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.576479 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76b7cff57-m4klx"] Jul 22 16:36:20.579564 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.579546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.582018 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.581994 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 16:36:20.582947 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.582929 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tf7g9\"" Jul 22 16:36:20.583043 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.582962 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 16:36:20.589420 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.589396 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b7cff57-m4klx"] Jul 22 16:36:20.740067 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.740030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-webhook-cert\") pod \"maas-controller-76b7cff57-m4klx\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.740067 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.740069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sd4w\" (UniqueName: \"kubernetes.io/projected/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-kube-api-access-9sd4w\") pod \"maas-controller-76b7cff57-m4klx\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.841390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.841296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-webhook-cert\") pod \"maas-controller-76b7cff57-m4klx\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.841390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.841333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sd4w\" (UniqueName: \"kubernetes.io/projected/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-kube-api-access-9sd4w\") pod \"maas-controller-76b7cff57-m4klx\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.843846 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.843816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-webhook-cert\") pod \"maas-controller-76b7cff57-m4klx\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.851140 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.851108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sd4w\" (UniqueName: \"kubernetes.io/projected/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-kube-api-access-9sd4w\") pod \"maas-controller-76b7cff57-m4klx\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:20.889990 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:20.889954 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:21.023269 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:21.023241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b7cff57-m4klx"] Jul 22 16:36:21.025921 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:36:21.025891 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b30ae2_a94b_4d13_a2b5_0ae98e494ae1.slice/crio-b5c85f44d7180d1875ea562d5b428b4b4181f6c41afbf889546816b77acc6b2e WatchSource:0}: Error finding container b5c85f44d7180d1875ea562d5b428b4b4181f6c41afbf889546816b77acc6b2e: Status 404 returned error can't find the container with id b5c85f44d7180d1875ea562d5b428b4b4181f6c41afbf889546816b77acc6b2e Jul 22 16:36:21.027332 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:21.027313 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:36:21.774648 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:21.774601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b7cff57-m4klx" event={"ID":"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1","Type":"ContainerStarted","Data":"b5c85f44d7180d1875ea562d5b428b4b4181f6c41afbf889546816b77acc6b2e"} Jul 22 16:36:23.784883 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:23.784784 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b7cff57-m4klx" event={"ID":"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1","Type":"ContainerStarted","Data":"052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30"} Jul 22 16:36:23.785225 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:23.784907 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:23.806983 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:23.806929 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76b7cff57-m4klx" podStartSLOduration=1.398957748 podStartE2EDuration="3.806910153s" totalImagesPullingTime="2.407952405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:36:23.804573599 +0000 UTC m=+920.557509761" watchObservedRunningTime="2026-07-22 16:36:23.806910153 +0000 UTC m=+920.559846304" Jul 22 16:36:34.791494 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:34.791463 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:39.385554 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.385517 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:36:39.500422 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.500388 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b7cff57-m4klx"] Jul 22 16:36:39.500602 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.500584 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76b7cff57-m4klx" podUID="61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" containerName="manager" containerID="cri-o://052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30" gracePeriod=30 Jul 22 16:36:39.737899 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.737874 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:39.790489 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.790454 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sd4w\" (UniqueName: \"kubernetes.io/projected/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-kube-api-access-9sd4w\") pod \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " Jul 22 16:36:39.790640 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.790532 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-webhook-cert\") pod \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\" (UID: \"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1\") " Jul 22 16:36:39.792651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.792618 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-kube-api-access-9sd4w" (OuterVolumeSpecName: "kube-api-access-9sd4w") pod "61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" (UID: "61b30ae2-a94b-4d13-a2b5-0ae98e494ae1"). InnerVolumeSpecName "kube-api-access-9sd4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:36:39.792651 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.792622 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" (UID: "61b30ae2-a94b-4d13-a2b5-0ae98e494ae1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:36:39.854303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.854271 2574 generic.go:356] "Generic (PLEG): container finished" podID="61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" containerID="052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30" exitCode=0 Jul 22 16:36:39.854473 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.854316 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b7cff57-m4klx" Jul 22 16:36:39.854473 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.854354 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b7cff57-m4klx" event={"ID":"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1","Type":"ContainerDied","Data":"052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30"} Jul 22 16:36:39.854473 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.854405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b7cff57-m4klx" event={"ID":"61b30ae2-a94b-4d13-a2b5-0ae98e494ae1","Type":"ContainerDied","Data":"b5c85f44d7180d1875ea562d5b428b4b4181f6c41afbf889546816b77acc6b2e"} Jul 22 16:36:39.854473 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.854427 2574 scope.go:117] "RemoveContainer" containerID="052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30" Jul 22 16:36:39.862996 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.862981 2574 scope.go:117] "RemoveContainer" containerID="052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30" Jul 22 16:36:39.863272 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:36:39.863246 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30\": container with ID starting with 052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30 not found: ID does not exist" containerID="052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30" Jul 22 16:36:39.863317 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.863283 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30"} err="failed to get container status \"052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30\": rpc error: code = NotFound desc = could not find container \"052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30\": container with ID starting with 052a49977116a377a5c43aeba93a9ac58a32b61e0f6fd1a3fdbed9258da0de30 not found: ID does not exist" Jul 22 16:36:39.885695 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.885646 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76b7cff57-m4klx"] Jul 22 16:36:39.885894 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.885709 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76b7cff57-m4klx"] Jul 22 16:36:39.891388 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.891341 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sd4w\" (UniqueName: \"kubernetes.io/projected/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-kube-api-access-9sd4w\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:36:39.891388 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:39.891367 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1-webhook-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:36:40.103810 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.103774 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" path="/var/lib/kubelet/pods/61b30ae2-a94b-4d13-a2b5-0ae98e494ae1/volumes" Jul 22 16:36:40.634589 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.634553 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:36:40.767707 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.767675 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76b7cff57-dchrb"] Jul 22 16:36:40.768020 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.768004 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" containerName="manager" Jul 22 16:36:40.768071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.768022 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" containerName="manager" Jul 22 16:36:40.768103 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.768078 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b30ae2-a94b-4d13-a2b5-0ae98e494ae1" containerName="manager" Jul 22 16:36:40.772434 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.772411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:40.776183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.776158 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 16:36:40.776326 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.776184 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tf7g9\"" Jul 22 16:36:40.776326 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.776189 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 16:36:40.781390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.781365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b7cff57-dchrb"] Jul 22 16:36:40.799366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.799335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcqtj\" (UniqueName: \"kubernetes.io/projected/c01efc96-1a3d-4900-b342-1cb7a59dbfb3-kube-api-access-fcqtj\") pod \"maas-controller-76b7cff57-dchrb\" (UID: \"c01efc96-1a3d-4900-b342-1cb7a59dbfb3\") " pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:40.799503 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.799370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c01efc96-1a3d-4900-b342-1cb7a59dbfb3-webhook-cert\") pod \"maas-controller-76b7cff57-dchrb\" (UID: \"c01efc96-1a3d-4900-b342-1cb7a59dbfb3\") " pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:40.899975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.899879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqtj\" (UniqueName: \"kubernetes.io/projected/c01efc96-1a3d-4900-b342-1cb7a59dbfb3-kube-api-access-fcqtj\") pod \"maas-controller-76b7cff57-dchrb\" (UID: \"c01efc96-1a3d-4900-b342-1cb7a59dbfb3\") " pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:40.899975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.899921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c01efc96-1a3d-4900-b342-1cb7a59dbfb3-webhook-cert\") pod \"maas-controller-76b7cff57-dchrb\" (UID: \"c01efc96-1a3d-4900-b342-1cb7a59dbfb3\") " pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:40.902517 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.902484 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c01efc96-1a3d-4900-b342-1cb7a59dbfb3-webhook-cert\") pod \"maas-controller-76b7cff57-dchrb\" (UID: \"c01efc96-1a3d-4900-b342-1cb7a59dbfb3\") " pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:40.909177 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:40.909148 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcqtj\" (UniqueName: \"kubernetes.io/projected/c01efc96-1a3d-4900-b342-1cb7a59dbfb3-kube-api-access-fcqtj\") pod \"maas-controller-76b7cff57-dchrb\" (UID: \"c01efc96-1a3d-4900-b342-1cb7a59dbfb3\") " pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:41.083802 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:41.083759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:41.228933 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:41.228907 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76b7cff57-dchrb"] Jul 22 16:36:41.231334 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:36:41.231313 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01efc96_1a3d_4900_b342_1cb7a59dbfb3.slice/crio-fd870985ca59842ec56a7d98e04aeba5281304166fd98888377d79f1d3c3dcbc WatchSource:0}: Error finding container fd870985ca59842ec56a7d98e04aeba5281304166fd98888377d79f1d3c3dcbc: Status 404 returned error can't find the container with id fd870985ca59842ec56a7d98e04aeba5281304166fd98888377d79f1d3c3dcbc Jul 22 16:36:41.864671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:41.864637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b7cff57-dchrb" event={"ID":"c01efc96-1a3d-4900-b342-1cb7a59dbfb3","Type":"ContainerStarted","Data":"fd870985ca59842ec56a7d98e04aeba5281304166fd98888377d79f1d3c3dcbc"} Jul 22 16:36:42.870580 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:42.870545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76b7cff57-dchrb" event={"ID":"c01efc96-1a3d-4900-b342-1cb7a59dbfb3","Type":"ContainerStarted","Data":"c12bb7f2c4ed58fff1c96100637d07bcd305c32606cd0f5b595d5ee530d397bc"} Jul 22 16:36:42.870996 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:42.870616 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:36:42.889289 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:42.889244 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76b7cff57-dchrb" podStartSLOduration=2.301961367 podStartE2EDuration="2.889227842s" totalImagesPullingTime="587.266475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:36:42.887709769 +0000 UTC m=+939.640645918" watchObservedRunningTime="2026-07-22 16:36:42.889227842 +0000 UTC m=+939.642163992" Jul 22 16:36:53.877891 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:36:53.877853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76b7cff57-dchrb" Jul 22 16:37:17.571930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:17.571892 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:19.215078 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:19.215041 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:23.989794 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:23.989759 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:24.095105 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:24.095056 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:24.189409 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:24.189375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:24.390101 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:24.390020 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:30.647086 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:30.646988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:37:30.712918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:37:30.712882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:40:09.907248 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:40:09.907212 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:41:07.558126 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:41:07.558092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:41:10.077103 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:41:10.077068 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:41:10.177515 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:41:10.177482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:43:55.576679 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:43:55.576645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:45:00.153183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.153103 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9"] Jul 22 16:45:00.156284 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.156268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" Jul 22 16:45:00.159154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.159133 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\"" Jul 22 16:45:00.165114 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.165096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" Jul 22 16:45:00.172590 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.172568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9"] Jul 22 16:45:00.294194 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.294169 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9"] Jul 22 16:45:00.296785 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:45:00.296751 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6c7ba4_c909_4d1d_87fd_790ff4a8ee77.slice/crio-49c3cdd6f8a67ee22ba709b4456d77002eed7d25134a359640c161e8d2c55b50 WatchSource:0}: Error finding container 49c3cdd6f8a67ee22ba709b4456d77002eed7d25134a359640c161e8d2c55b50: Status 404 returned error can't find the container with id 49c3cdd6f8a67ee22ba709b4456d77002eed7d25134a359640c161e8d2c55b50 Jul 22 16:45:00.298775 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.298757 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 16:45:00.892230 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:00.892196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" event={"ID":"aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77","Type":"ContainerStarted","Data":"49c3cdd6f8a67ee22ba709b4456d77002eed7d25134a359640c161e8d2c55b50"} Jul 22 16:45:02.903649 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:02.903553 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" event={"ID":"aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77","Type":"ContainerStarted","Data":"64f315261c7196f66e926bc6f01363e5ca9a92d4b9f0714fc7182e1d42454b2e"} Jul 22 16:45:02.923254 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:02.923206 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" podStartSLOduration=0.698725404 podStartE2EDuration="2.923189138s" totalImagesPullingTime="2.224463734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:45:02.921770767 +0000 UTC m=+1439.674706930" watchObservedRunningTime="2026-07-22 16:45:02.923189138 +0000 UTC m=+1439.676125318" Jul 22 16:45:03.908560 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:03.908478 2574 generic.go:356] "Generic (PLEG): container finished" podID="aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77" containerID="64f315261c7196f66e926bc6f01363e5ca9a92d4b9f0714fc7182e1d42454b2e" exitCode=0 Jul 22 16:45:03.908925 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:03.908558 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" event={"ID":"aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77","Type":"ContainerDied","Data":"64f315261c7196f66e926bc6f01363e5ca9a92d4b9f0714fc7182e1d42454b2e"} Jul 22 16:45:05.034067 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:05.034035 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" Jul 22 16:45:05.917962 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:05.917934 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" Jul 22 16:45:05.917962 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:05.917945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745645-kgbn9" event={"ID":"aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77","Type":"ContainerDied","Data":"49c3cdd6f8a67ee22ba709b4456d77002eed7d25134a359640c161e8d2c55b50"} Jul 22 16:45:05.918253 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:05.917992 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49c3cdd6f8a67ee22ba709b4456d77002eed7d25134a359640c161e8d2c55b50" Jul 22 16:45:28.800785 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.800741 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk"] Jul 22 16:45:28.801239 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.801219 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77" containerName="cleanup" Jul 22 16:45:28.801284 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.801244 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77" containerName="cleanup" Jul 22 16:45:28.801359 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.801348 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77" containerName="cleanup" Jul 22 16:45:28.804684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.804664 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.807548 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.807524 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-6257eb31-kserve-self-signed-certs\"" Jul 22 16:45:28.812286 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.812110 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk"] Jul 22 16:45:28.837705 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.837657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tmp-dir\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.837705 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.837701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tls-certs\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.837982 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.837747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdfz\" (UniqueName: \"kubernetes.io/projected/fcb3e78b-1391-49f7-b164-8f960a30f0b4-kube-api-access-7gdfz\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.837982 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.837775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-model-cache\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.837982 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.837801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-home\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.837982 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.837919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-dshm\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.851868 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.851821 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:45:28.938687 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.938650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tmp-dir\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.938687 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.938684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tls-certs\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.938712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdfz\" (UniqueName: \"kubernetes.io/projected/fcb3e78b-1391-49f7-b164-8f960a30f0b4-kube-api-access-7gdfz\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.938738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-model-cache\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.938757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-home\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.938784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-dshm\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939239 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.939170 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tmp-dir\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939275 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.939249 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-model-cache\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.939308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.939278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-home\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.941163 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.941142 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-dshm\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.941426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.941405 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tls-certs\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:28.948491 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:28.948449 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdfz\" (UniqueName: \"kubernetes.io/projected/fcb3e78b-1391-49f7-b164-8f960a30f0b4-kube-api-access-7gdfz\") pod \"e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:29.115655 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:29.115564 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:29.251262 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:29.251237 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk"] Jul 22 16:45:29.253455 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:45:29.253427 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcb3e78b_1391_49f7_b164_8f960a30f0b4.slice/crio-e512db918e57a7a799ac5778c62ecebefa9e0182f618a05469e36b6bce062848 WatchSource:0}: Error finding container e512db918e57a7a799ac5778c62ecebefa9e0182f618a05469e36b6bce062848: Status 404 returned error can't find the container with id e512db918e57a7a799ac5778c62ecebefa9e0182f618a05469e36b6bce062848 Jul 22 16:45:30.019109 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:30.019061 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" event={"ID":"fcb3e78b-1391-49f7-b164-8f960a30f0b4","Type":"ContainerStarted","Data":"1cbd88979661dff68270a182c4b37171069a065972e6cee26ac47ce0c6a26689"} Jul 22 16:45:30.019109 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:30.019113 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" event={"ID":"fcb3e78b-1391-49f7-b164-8f960a30f0b4","Type":"ContainerStarted","Data":"e512db918e57a7a799ac5778c62ecebefa9e0182f618a05469e36b6bce062848"} Jul 22 16:45:30.037771 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:30.037720 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" podStartSLOduration=2.037705367 podStartE2EDuration="2.037705367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:45:30.036974533 +0000 UTC m=+1466.789910707" watchObservedRunningTime="2026-07-22 16:45:30.037705367 +0000 UTC m=+1466.790641517" Jul 22 16:45:39.115869 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:39.115811 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:39.116381 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:39.115890 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:39.128407 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:39.128377 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:40.075299 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:40.075265 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:45:40.423375 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:45:40.423292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:46:34.116002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:34.115910 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk"] Jul 22 16:46:35.056348 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:35.056312 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:46:35.111293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:35.111260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:46:49.137668 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.137621 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" podUID="fcb3e78b-1391-49f7-b164-8f960a30f0b4" containerName="main" containerID="cri-o://1cbd88979661dff68270a182c4b37171069a065972e6cee26ac47ce0c6a26689" gracePeriod=45 Jul 22 16:46:49.351170 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.351133 2574 generic.go:356] "Generic (PLEG): container finished" podID="fcb3e78b-1391-49f7-b164-8f960a30f0b4" containerID="1cbd88979661dff68270a182c4b37171069a065972e6cee26ac47ce0c6a26689" exitCode=0 Jul 22 16:46:49.351325 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.351206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" event={"ID":"fcb3e78b-1391-49f7-b164-8f960a30f0b4","Type":"ContainerDied","Data":"1cbd88979661dff68270a182c4b37171069a065972e6cee26ac47ce0c6a26689"} Jul 22 16:46:49.384329 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.384308 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:46:49.550268 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550227 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gdfz\" (UniqueName: \"kubernetes.io/projected/fcb3e78b-1391-49f7-b164-8f960a30f0b4-kube-api-access-7gdfz\") pod \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " Jul 22 16:46:49.550437 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550319 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tls-certs\") pod \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " Jul 22 16:46:49.550437 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550367 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tmp-dir\") pod \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " Jul 22 16:46:49.550437 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550404 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-home\") pod \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " Jul 22 16:46:49.550437 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550419 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-dshm\") pod \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " Jul 22 16:46:49.550697 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550445 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-model-cache\") pod \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\" (UID: \"fcb3e78b-1391-49f7-b164-8f960a30f0b4\") " Jul 22 16:46:49.550754 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550728 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-home" (OuterVolumeSpecName: "home") pod "fcb3e78b-1391-49f7-b164-8f960a30f0b4" (UID: "fcb3e78b-1391-49f7-b164-8f960a30f0b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:46:49.550807 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550757 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fcb3e78b-1391-49f7-b164-8f960a30f0b4" (UID: "fcb3e78b-1391-49f7-b164-8f960a30f0b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:46:49.550923 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.550899 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "fcb3e78b-1391-49f7-b164-8f960a30f0b4" (UID: "fcb3e78b-1391-49f7-b164-8f960a30f0b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:46:49.552551 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.552520 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-dshm" (OuterVolumeSpecName: "dshm") pod "fcb3e78b-1391-49f7-b164-8f960a30f0b4" (UID: "fcb3e78b-1391-49f7-b164-8f960a30f0b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:46:49.552551 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.552531 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb3e78b-1391-49f7-b164-8f960a30f0b4-kube-api-access-7gdfz" (OuterVolumeSpecName: "kube-api-access-7gdfz") pod "fcb3e78b-1391-49f7-b164-8f960a30f0b4" (UID: "fcb3e78b-1391-49f7-b164-8f960a30f0b4"). InnerVolumeSpecName "kube-api-access-7gdfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:46:49.552713 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.552614 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fcb3e78b-1391-49f7-b164-8f960a30f0b4" (UID: "fcb3e78b-1391-49f7-b164-8f960a30f0b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 16:46:49.651986 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.651951 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gdfz\" (UniqueName: \"kubernetes.io/projected/fcb3e78b-1391-49f7-b164-8f960a30f0b4-kube-api-access-7gdfz\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:46:49.651986 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.651982 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tls-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:46:49.651986 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.651994 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-tmp-dir\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:46:49.652216 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.652002 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-home\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:46:49.652216 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.652010 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-dshm\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:46:49.652216 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:49.652017 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcb3e78b-1391-49f7-b164-8f960a30f0b4-model-cache\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:46:50.356762 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:50.356725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" event={"ID":"fcb3e78b-1391-49f7-b164-8f960a30f0b4","Type":"ContainerDied","Data":"e512db918e57a7a799ac5778c62ecebefa9e0182f618a05469e36b6bce062848"} Jul 22 16:46:50.357213 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:50.356776 2574 scope.go:117] "RemoveContainer" containerID="1cbd88979661dff68270a182c4b37171069a065972e6cee26ac47ce0c6a26689" Jul 22 16:46:50.357213 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:50.356744 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk" Jul 22 16:46:50.374365 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:50.374336 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk"] Jul 22 16:46:50.376643 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:50.376622 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-6257eb31-kserve-5b4879f88c-8w6gk"] Jul 22 16:46:52.108253 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:46:52.108196 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcb3e78b-1391-49f7-b164-8f960a30f0b4" path="/var/lib/kubelet/pods/fcb3e78b-1391-49f7-b164-8f960a30f0b4/volumes" Jul 22 16:47:11.291737 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:47:11.291704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:47:22.603628 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:47:22.603591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:49:23.870745 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:49:23.870704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:49:25.317152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:49:25.317120 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:49:49.470630 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:49:49.470593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:13.187346 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:13.187313 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:16.308036 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:16.308003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:16.405625 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:16.405587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:16.802054 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:16.802020 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:22.864698 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:22.864660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:23.008439 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.008406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:23.108688 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.108658 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:23.353124 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.353085 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x"] Jul 22 16:50:23.353797 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.353773 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb3e78b-1391-49f7-b164-8f960a30f0b4" containerName="main" Jul 22 16:50:23.353797 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.353798 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb3e78b-1391-49f7-b164-8f960a30f0b4" containerName="main" Jul 22 16:50:23.353962 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.353950 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb3e78b-1391-49f7-b164-8f960a30f0b4" containerName="main" Jul 22 16:50:23.357755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.357726 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.360323 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.360305 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c9720566-openshift-default-dockercfg-wv6xz\"" Jul 22 16:50:23.375929 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.375887 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x"] Jul 22 16:50:23.384785 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.384756 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:23.487214 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-envoy\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487214 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-credential-socket\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487433 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-token\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487433 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istiod-ca-cert\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487540 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-podinfo\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487540 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-certs\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487540 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-socket\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487540 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-data\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.487666 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.487555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkq77\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-kube-api-access-zkq77\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588375 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-podinfo\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588549 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-certs\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588549 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-socket\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588549 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-data\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkq77\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-kube-api-access-zkq77\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-envoy\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-credential-socket\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-token\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588908 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istiod-ca-cert\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.588908 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.588795 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-certs\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.589047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.589027 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-socket\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.589169 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.589150 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-credential-socket\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.589233 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.589215 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-data\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.589383 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.589367 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istiod-ca-cert\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.590935 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.590907 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-envoy\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.591210 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.591193 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-podinfo\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.597774 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.597743 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-token\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.597956 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.597916 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkq77\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-kube-api-access-zkq77\") pod \"e2e-ait-c9720566-openshift-default-8456678b5f-64h8x\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.669271 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.669176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:23.682423 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.682390 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:23.810376 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.810333 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x"] Jul 22 16:50:23.812626 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:50:23.812601 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda401ddc_7f12_4dd2_9ef1_805f0c4af9c8.slice/crio-34288df96d88608233b99d7989a0d391db82a450914b929871e48651a9d691fb WatchSource:0}: Error finding container 34288df96d88608233b99d7989a0d391db82a450914b929871e48651a9d691fb: Status 404 returned error can't find the container with id 34288df96d88608233b99d7989a0d391db82a450914b929871e48651a9d691fb Jul 22 16:50:23.814664 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.814630 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:50:23.814745 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.814697 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:50:23.814745 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:23.814726 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:50:24.237439 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:24.237404 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" event={"ID":"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8","Type":"ContainerStarted","Data":"1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85"} Jul 22 16:50:24.237816 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:24.237456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" event={"ID":"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8","Type":"ContainerStarted","Data":"34288df96d88608233b99d7989a0d391db82a450914b929871e48651a9d691fb"} Jul 22 16:50:24.259055 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:24.258997 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podStartSLOduration=1.258982443 podStartE2EDuration="1.258982443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:50:24.257667056 +0000 UTC m=+1761.010603205" watchObservedRunningTime="2026-07-22 16:50:24.258982443 +0000 UTC m=+1761.011918667" Jul 22 16:50:24.670101 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:24.670013 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:24.674623 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:24.674599 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:25.241668 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:25.241637 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:25.242711 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:25.242696 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:25.602634 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:25.602545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:25.685829 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:25.685794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:25.751578 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:25.751539 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:25.864362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:25.864277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:26.299275 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:26.299242 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:26.401010 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:26.400973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:50:41.095300 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.094899 2574 patch_prober.go:28] interesting pod/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": read tcp 10.134.0.2:49690->10.134.0.28:15021: read: connection reset by peer" start-of-body= Jul 22 16:50:41.095300 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.095014 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": read tcp 10.134.0.2:49690->10.134.0.28:15021: read: connection reset by peer" Jul 22 16:50:41.310454 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.310374 2574 generic.go:356] "Generic (PLEG): container finished" podID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerID="1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85" exitCode=0 Jul 22 16:50:41.310454 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.310435 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" event={"ID":"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8","Type":"ContainerDied","Data":"1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85"} Jul 22 16:50:41.310823 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.310811 2574 scope.go:117] "RemoveContainer" containerID="1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85" Jul 22 16:50:41.311914 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.311884 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:50:41.311979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.311952 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:50:41.312015 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:41.311984 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:50:42.316502 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:42.316468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" event={"ID":"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8","Type":"ContainerStarted","Data":"5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa"} Jul 22 16:50:42.670247 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:42.670148 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:42.670427 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:42.670402 2574 patch_prober.go:28] interesting pod/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 22 16:50:42.670476 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:42.670454 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 22 16:50:43.670314 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:43.670282 2574 patch_prober.go:28] interesting pod/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 22 16:50:43.670755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:43.670334 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 22 16:50:44.670546 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:44.670514 2574 patch_prober.go:28] interesting pod/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 22 16:50:44.670933 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:44.670567 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 22 16:50:45.670195 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:45.670156 2574 patch_prober.go:28] interesting pod/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 22 16:50:45.670415 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:45.670225 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 22 16:50:46.673740 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:46.673711 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:46.674131 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:46.674062 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:50:46.674703 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:50:46.674674 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:51:01.872463 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:01.872376 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:06.363296 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:06.363227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:06.505111 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:06.505077 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x"] Jul 22 16:51:06.505358 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:06.505333 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" containerID="cri-o://5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa" gracePeriod=30 Jul 22 16:51:06.528280 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:06.528248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:06.784093 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:06.784065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:07.051366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.051204 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:07.151404 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.151344 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:07.293417 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.293377 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:07.594568 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.594535 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv"] Jul 22 16:51:07.598121 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.598102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.600488 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.600466 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-30e2948f-gw-openshift-default-dockercfg-9ftcl\"" Jul 22 16:51:07.609970 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.609945 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv"] Jul 22 16:51:07.622162 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.622131 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:07.669764 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.669720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkpkl\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-kube-api-access-gkpkl\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.669975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.669782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-envoy\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.669975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.669825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-certs\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.669975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.669886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-credential-socket\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.669975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.669911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-istio-token\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.670178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.670027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-data\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.670178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.670094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57813375-26c9-46d3-affb-011f24f05f01-istio-podinfo\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.670178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.670135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57813375-26c9-46d3-affb-011f24f05f01-istiod-ca-cert\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.670178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.670164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-socket\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.770694 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.770630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-data\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.770918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.770733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57813375-26c9-46d3-affb-011f24f05f01-istio-podinfo\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.770918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.770782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57813375-26c9-46d3-affb-011f24f05f01-istiod-ca-cert\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771015 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.770907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-socket\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771015 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.770952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkpkl\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-kube-api-access-gkpkl\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771015 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.770990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-envoy\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771157 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-certs\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771157 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-credential-socket\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771157 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-istio-token\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771157 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771149 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-data\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771335 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771242 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-socket\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771423 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771399 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-certs\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771530 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771507 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57813375-26c9-46d3-affb-011f24f05f01-istiod-ca-cert\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.771587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.771553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-credential-socket\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.773320 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.773298 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-envoy\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.773532 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.773512 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57813375-26c9-46d3-affb-011f24f05f01-istio-podinfo\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.779672 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.779646 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-istio-token\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.779773 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.779692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkpkl\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-kube-api-access-gkpkl\") pod \"e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:07.910523 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:07.910434 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:08.055813 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.055723 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv"] Jul 22 16:51:08.058227 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:51:08.058203 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57813375_26c9_46d3_affb_011f24f05f01.slice/crio-826b3d2caaa8041efb1e537630eea81f7f192803e05115e95f0bffa075b020da WatchSource:0}: Error finding container 826b3d2caaa8041efb1e537630eea81f7f192803e05115e95f0bffa075b020da: Status 404 returned error can't find the container with id 826b3d2caaa8041efb1e537630eea81f7f192803e05115e95f0bffa075b020da Jul 22 16:51:08.060891 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.060858 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:08.060969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.060919 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:08.060969 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.060949 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:08.181711 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.181677 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:08.429177 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.429139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" event={"ID":"57813375-26c9-46d3-affb-011f24f05f01","Type":"ContainerStarted","Data":"c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b"} Jul 22 16:51:08.429350 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.429225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" event={"ID":"57813375-26c9-46d3-affb-011f24f05f01","Type":"ContainerStarted","Data":"826b3d2caaa8041efb1e537630eea81f7f192803e05115e95f0bffa075b020da"} Jul 22 16:51:08.450659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.450556 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podStartSLOduration=1.450540033 podStartE2EDuration="1.450540033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:51:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:51:08.449523507 +0000 UTC m=+1805.202459661" watchObservedRunningTime="2026-07-22 16:51:08.450540033 +0000 UTC m=+1805.203476182" Jul 22 16:51:08.911016 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:08.910928 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:09.915662 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:09.915630 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:10.017766 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.017722 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:10.136974 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.136943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:10.218671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.218638 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:10.438183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.438157 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:10.439199 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.439178 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:10.744390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.744359 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:10.844077 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:10.844046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:11.763465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.763438 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:51:11.910053 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.909957 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-token\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910053 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910002 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-socket\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910053 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910028 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-certs\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910053 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910051 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkq77\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-kube-api-access-zkq77\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910075 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-podinfo\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910104 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-envoy\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910123 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istiod-ca-cert\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-data\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910213 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-credential-socket\") pod \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\" (UID: \"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8\") " Jul 22 16:51:11.910379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910291 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:11.910714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910432 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:11.910714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910529 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:11.910714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910536 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:51:11.910714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910524 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:11.910714 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.910545 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:11.911184 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.911158 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:11.912646 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.912625 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 16:51:11.912646 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.912632 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:11.912783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.912763 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-kube-api-access-zkq77" (OuterVolumeSpecName: "kube-api-access-zkq77") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "kube-api-access-zkq77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:51:11.912847 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:11.912822 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" (UID: "da401ddc-7f12-4dd2-9ef1-805f0c4af9c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:51:12.011676 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011643 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.011676 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011671 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkq77\" (UniqueName: \"kubernetes.io/projected/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-kube-api-access-zkq77\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.011676 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011684 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.011930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011693 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.011930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011701 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.011930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011708 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.011930 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.011716 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:12.447701 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.447665 2574 generic.go:356] "Generic (PLEG): container finished" podID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerID="5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa" exitCode=0 Jul 22 16:51:12.447918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.447711 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" Jul 22 16:51:12.447918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.447751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" event={"ID":"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8","Type":"ContainerDied","Data":"5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa"} Jul 22 16:51:12.447918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.447804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x" event={"ID":"da401ddc-7f12-4dd2-9ef1-805f0c4af9c8","Type":"ContainerDied","Data":"34288df96d88608233b99d7989a0d391db82a450914b929871e48651a9d691fb"} Jul 22 16:51:12.447918 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.447852 2574 scope.go:117] "RemoveContainer" containerID="5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa" Jul 22 16:51:12.456707 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.456693 2574 scope.go:117] "RemoveContainer" containerID="1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85" Jul 22 16:51:12.464643 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.464621 2574 scope.go:117] "RemoveContainer" containerID="5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa" Jul 22 16:51:12.464949 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:51:12.464923 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa\": container with ID starting with 5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa not found: ID does not exist" containerID="5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa" Jul 22 16:51:12.465041 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.464961 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa"} err="failed to get container status \"5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa\": rpc error: code = NotFound desc = could not find container \"5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa\": container with ID starting with 5ef2dc2f0db9aaee849695173cf1ff1449ff9e1c3f4360da77c01caab10672aa not found: ID does not exist" Jul 22 16:51:12.465041 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.464986 2574 scope.go:117] "RemoveContainer" containerID="1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85" Jul 22 16:51:12.465257 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:51:12.465234 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85\": container with ID starting with 1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85 not found: ID does not exist" containerID="1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85" Jul 22 16:51:12.465351 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.465268 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85"} err="failed to get container status \"1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85\": rpc error: code = NotFound desc = could not find container \"1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85\": container with ID starting with 1e52761c24815d351bbc5b1efc1035e7c4a75295650283daaf644641b9ea3c85 not found: ID does not exist" Jul 22 16:51:12.469519 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.469494 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x"] Jul 22 16:51:12.473728 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:12.473701 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c9720566-openshift-default-8456678b5f-64h8x"] Jul 22 16:51:14.103691 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:14.103654 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" path="/var/lib/kubelet/pods/da401ddc-7f12-4dd2-9ef1-805f0c4af9c8/volumes" Jul 22 16:51:25.440239 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.440204 2574 patch_prober.go:28] interesting pod/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 22 16:51:25.440641 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.440271 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 22 16:51:25.509174 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.509137 2574 generic.go:356] "Generic (PLEG): container finished" podID="57813375-26c9-46d3-affb-011f24f05f01" containerID="c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b" exitCode=0 Jul 22 16:51:25.509376 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.509211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" event={"ID":"57813375-26c9-46d3-affb-011f24f05f01","Type":"ContainerDied","Data":"c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b"} Jul 22 16:51:25.509633 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.509617 2574 scope.go:117] "RemoveContainer" containerID="c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b" Jul 22 16:51:25.510654 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.510626 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:25.510738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.510693 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:25.510738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:25.510724 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:26.515331 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:26.515288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" event={"ID":"57813375-26c9-46d3-affb-011f24f05f01","Type":"ContainerStarted","Data":"be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0"} Jul 22 16:51:26.911713 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:26.911619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:26.911920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:26.911896 2574 patch_prober.go:28] interesting pod/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 22 16:51:26.911977 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:26.911958 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 22 16:51:27.911705 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:27.911665 2574 patch_prober.go:28] interesting pod/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 22 16:51:27.912152 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:27.911724 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 22 16:51:28.911659 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:28.911623 2574 patch_prober.go:28] interesting pod/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 22 16:51:28.911864 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:28.911683 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 22 16:51:29.910809 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:29.910771 2574 patch_prober.go:28] interesting pod/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 22 16:51:29.911017 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:29.910827 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 22 16:51:30.914544 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:30.914511 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:30.914945 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:30.914867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:30.915639 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:30.915619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:34.947293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.947258 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d"] Jul 22 16:51:34.947738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.947563 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" Jul 22 16:51:34.947738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.947575 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" Jul 22 16:51:34.947738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.947586 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" Jul 22 16:51:34.947738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.947591 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" Jul 22 16:51:34.947738 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.947636 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" Jul 22 16:51:34.950625 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.950609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:34.953079 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.953058 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 16:51:34.953206 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.953169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\"" Jul 22 16:51:34.958431 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:34.958207 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d"] Jul 22 16:51:35.021159 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:35.021122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cc417-d157-4f6f-99ed-7b62943cf4da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d\" (UID: \"972cc417-d157-4f6f-99ed-7b62943cf4da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:35.122130 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:35.122092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cc417-d157-4f6f-99ed-7b62943cf4da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d\" (UID: \"972cc417-d157-4f6f-99ed-7b62943cf4da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:35.122726 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:35.122708 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cc417-d157-4f6f-99ed-7b62943cf4da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d\" (UID: \"972cc417-d157-4f6f-99ed-7b62943cf4da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:35.263049 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:35.262965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:35.392538 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:35.392514 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d"] Jul 22 16:51:35.394725 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:51:35.394695 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972cc417_d157_4f6f_99ed_7b62943cf4da.slice/crio-dac47194378b717709f719394a37a765641b5ad699a227216d8e086502f6f19f WatchSource:0}: Error finding container dac47194378b717709f719394a37a765641b5ad699a227216d8e086502f6f19f: Status 404 returned error can't find the container with id dac47194378b717709f719394a37a765641b5ad699a227216d8e086502f6f19f Jul 22 16:51:35.556797 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:35.556707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" event={"ID":"972cc417-d157-4f6f-99ed-7b62943cf4da","Type":"ContainerStarted","Data":"dac47194378b717709f719394a37a765641b5ad699a227216d8e086502f6f19f"} Jul 22 16:51:36.562724 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:36.562691 2574 generic.go:356] "Generic (PLEG): container finished" podID="972cc417-d157-4f6f-99ed-7b62943cf4da" containerID="1d3da3510b7219bb07f3e6a64fd254033d520cb197af1fc4e284327f9497c6b3" exitCode=0 Jul 22 16:51:36.563139 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:36.562761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" event={"ID":"972cc417-d157-4f6f-99ed-7b62943cf4da","Type":"ContainerDied","Data":"1d3da3510b7219bb07f3e6a64fd254033d520cb197af1fc4e284327f9497c6b3"} Jul 22 16:51:37.700038 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:37.700010 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:37.746493 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:37.746458 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cc417-d157-4f6f-99ed-7b62943cf4da-maas-api-service-ca\") pod \"972cc417-d157-4f6f-99ed-7b62943cf4da\" (UID: \"972cc417-d157-4f6f-99ed-7b62943cf4da\") " Jul 22 16:51:37.746830 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:37.746806 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972cc417-d157-4f6f-99ed-7b62943cf4da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "972cc417-d157-4f6f-99ed-7b62943cf4da" (UID: "972cc417-d157-4f6f-99ed-7b62943cf4da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:51:37.847232 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:37.847146 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972cc417-d157-4f6f-99ed-7b62943cf4da-maas-api-service-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:38.573016 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:38.572988 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" Jul 22 16:51:38.573196 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:38.573028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d" event={"ID":"972cc417-d157-4f6f-99ed-7b62943cf4da","Type":"ContainerDied","Data":"dac47194378b717709f719394a37a765641b5ad699a227216d8e086502f6f19f"} Jul 22 16:51:38.573196 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:38.573072 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dac47194378b717709f719394a37a765641b5ad699a227216d8e086502f6f19f" Jul 22 16:51:45.494149 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:45.494109 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:50.041761 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.041718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:50.044028 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.044003 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d"] Jul 22 16:51:50.050426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.050393 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-30e2948f-77z7d"] Jul 22 16:51:50.103812 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.103776 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="972cc417-d157-4f6f-99ed-7b62943cf4da" path="/var/lib/kubelet/pods/972cc417-d157-4f6f-99ed-7b62943cf4da/volumes" Jul 22 16:51:50.205857 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.205814 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv"] Jul 22 16:51:50.206058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.206034 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" containerID="cri-o://be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0" gracePeriod=30 Jul 22 16:51:50.229860 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.229809 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:50.559983 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.559948 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:50.766473 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:50.766437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:51.136795 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.136759 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf"] Jul 22 16:51:51.137194 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.137137 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="972cc417-d157-4f6f-99ed-7b62943cf4da" containerName="revoke-keys" Jul 22 16:51:51.137194 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.137150 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="972cc417-d157-4f6f-99ed-7b62943cf4da" containerName="revoke-keys" Jul 22 16:51:51.137263 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.137218 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="972cc417-d157-4f6f-99ed-7b62943cf4da" containerName="revoke-keys" Jul 22 16:51:51.137263 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.137226 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="da401ddc-7f12-4dd2-9ef1-805f0c4af9c8" containerName="istio-proxy" Jul 22 16:51:51.140337 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.140320 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.143233 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.143207 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-66fe2bd0-openshift-default-dockercfg-g7h8x\"" Jul 22 16:51:51.152409 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.152381 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf"] Jul 22 16:51:51.161540 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.161503 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:51.267989 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.267954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj46f\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-kube-api-access-kj46f\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268198 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268006 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-data\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268198 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-socket\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268198 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-credential-socket\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268198 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-envoy\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268198 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-certs\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268458 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-token\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268458 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-podinfo\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.268458 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.268293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istiod-ca-cert\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369106 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-envoy\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369106 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-certs\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-token\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-podinfo\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istiod-ca-cert\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj46f\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-kube-api-access-kj46f\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-data\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369609 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-socket\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369609 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-credential-socket\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369706 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-certs\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369706 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-data\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.369900 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369875 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-socket\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.370014 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.369936 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-credential-socket\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.370123 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.370101 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istiod-ca-cert\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.371763 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.371743 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-envoy\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.372222 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.372200 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-podinfo\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.379028 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.379004 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj46f\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-kube-api-access-kj46f\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.379208 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.379179 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-token\") pod \"e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.452674 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.452632 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:51.567083 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.567050 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:51.594421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.594398 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf"] Jul 22 16:51:51.596081 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:51:51.596057 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec691fc7_c08a_41c0_a20e_23e55007b1ce.slice/crio-2228f4043d9abf88ca25f31adda13822be6aa656876910a239a9fefe438da48c WatchSource:0}: Error finding container 2228f4043d9abf88ca25f31adda13822be6aa656876910a239a9fefe438da48c: Status 404 returned error can't find the container with id 2228f4043d9abf88ca25f31adda13822be6aa656876910a239a9fefe438da48c Jul 22 16:51:51.598562 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.598526 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:51.598635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.598593 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:51.598635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.598624 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:51:51.636635 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:51.636606 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" event={"ID":"ec691fc7-c08a-41c0-a20e-23e55007b1ce","Type":"ContainerStarted","Data":"2228f4043d9abf88ca25f31adda13822be6aa656876910a239a9fefe438da48c"} Jul 22 16:51:52.642188 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:52.642149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" event={"ID":"ec691fc7-c08a-41c0-a20e-23e55007b1ce","Type":"ContainerStarted","Data":"2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55"} Jul 22 16:51:52.667665 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:52.667598 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podStartSLOduration=1.667579222 podStartE2EDuration="1.667579222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:51:52.666514184 +0000 UTC m=+1849.419450340" watchObservedRunningTime="2026-07-22 16:51:52.667579222 +0000 UTC m=+1849.420515371" Jul 22 16:51:53.453167 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:53.453121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:53.458395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:53.458370 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:53.646216 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:53.646186 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:53.647331 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:53.647312 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:51:54.053098 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:54.053064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:54.139116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:54.139085 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:54.231301 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:54.231275 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:54.524194 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:54.524161 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:54.762878 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:54.762849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:54.863559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:54.863475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:51:55.453672 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.453644 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:55.607165 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607083 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-envoy\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607165 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607159 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-certs\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607179 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-credential-socket\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607197 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-data\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607213 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57813375-26c9-46d3-affb-011f24f05f01-istiod-ca-cert\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607237 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkpkl\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-kube-api-access-gkpkl\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607257 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57813375-26c9-46d3-affb-011f24f05f01-istio-podinfo\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607286 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-istio-token\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607340 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-socket\") pod \"57813375-26c9-46d3-affb-011f24f05f01\" (UID: \"57813375-26c9-46d3-affb-011f24f05f01\") " Jul 22 16:51:55.607708 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607523 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:55.607708 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607588 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:55.607821 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607745 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:55.607821 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.607780 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57813375-26c9-46d3-affb-011f24f05f01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:51:55.608156 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.608116 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-data" (OuterVolumeSpecName: "istio-data") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:55.609427 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.609392 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:51:55.609628 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.609601 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57813375-26c9-46d3-affb-011f24f05f01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 16:51:55.609720 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.609627 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-istio-token" (OuterVolumeSpecName: "istio-token") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:51:55.609927 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.609906 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-kube-api-access-gkpkl" (OuterVolumeSpecName: "kube-api-access-gkpkl") pod "57813375-26c9-46d3-affb-011f24f05f01" (UID: "57813375-26c9-46d3-affb-011f24f05f01"). InnerVolumeSpecName "kube-api-access-gkpkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:51:55.656677 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.656642 2574 generic.go:356] "Generic (PLEG): container finished" podID="57813375-26c9-46d3-affb-011f24f05f01" containerID="be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0" exitCode=0 Jul 22 16:51:55.656872 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.656690 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" Jul 22 16:51:55.656872 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.656732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" event={"ID":"57813375-26c9-46d3-affb-011f24f05f01","Type":"ContainerDied","Data":"be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0"} Jul 22 16:51:55.656872 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.656812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv" event={"ID":"57813375-26c9-46d3-affb-011f24f05f01","Type":"ContainerDied","Data":"826b3d2caaa8041efb1e537630eea81f7f192803e05115e95f0bffa075b020da"} Jul 22 16:51:55.656872 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.656853 2574 scope.go:117] "RemoveContainer" containerID="be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0" Jul 22 16:51:55.665401 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.665382 2574 scope.go:117] "RemoveContainer" containerID="c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b" Jul 22 16:51:55.672814 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.672797 2574 scope.go:117] "RemoveContainer" containerID="be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0" Jul 22 16:51:55.673099 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:51:55.673080 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0\": container with ID starting with be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0 not found: ID does not exist" containerID="be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0" Jul 22 16:51:55.673158 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.673107 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0"} err="failed to get container status \"be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0\": rpc error: code = NotFound desc = could not find container \"be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0\": container with ID starting with be2b3d05f8076162993219f81eeedae8e9f1d45d50e387f5c8519817ec8e8db0 not found: ID does not exist" Jul 22 16:51:55.673158 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.673124 2574 scope.go:117] "RemoveContainer" containerID="c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b" Jul 22 16:51:55.673376 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:51:55.673359 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b\": container with ID starting with c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b not found: ID does not exist" containerID="c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b" Jul 22 16:51:55.673425 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.673380 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b"} err="failed to get container status \"c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b\": rpc error: code = NotFound desc = could not find container \"c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b\": container with ID starting with c71ff7a835794e4d04712504b7b5442553d0dfefb4874f6f8e760dee993b8c6b not found: ID does not exist" Jul 22 16:51:55.679239 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.679215 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv"] Jul 22 16:51:55.685811 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.685788 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-30e2948f-gw-openshift-default-5747845759-zl4zv"] Jul 22 16:51:55.708892 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708867 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.708892 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708892 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708903 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708913 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57813375-26c9-46d3-affb-011f24f05f01-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708921 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkpkl\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-kube-api-access-gkpkl\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708929 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57813375-26c9-46d3-affb-011f24f05f01-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708938 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57813375-26c9-46d3-affb-011f24f05f01-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708946 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:55.709046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:55.708953 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57813375-26c9-46d3-affb-011f24f05f01-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:51:56.103633 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:51:56.103601 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57813375-26c9-46d3-affb-011f24f05f01" path="/var/lib/kubelet/pods/57813375-26c9-46d3-affb-011f24f05f01/volumes" Jul 22 16:52:03.592412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:03.592380 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:03.692251 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:03.692216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:08.730980 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:08.729898 2574 patch_prober.go:28] interesting pod/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:60598->10.134.0.31:15021: read: connection reset by peer" start-of-body= Jul 22 16:52:08.730980 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:08.729963 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:60598->10.134.0.31:15021: read: connection reset by peer" Jul 22 16:52:09.726343 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:09.726308 2574 generic.go:356] "Generic (PLEG): container finished" podID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerID="2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55" exitCode=0 Jul 22 16:52:09.726496 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:09.726380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" event={"ID":"ec691fc7-c08a-41c0-a20e-23e55007b1ce","Type":"ContainerDied","Data":"2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55"} Jul 22 16:52:09.726786 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:09.726773 2574 scope.go:117] "RemoveContainer" containerID="2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55" Jul 22 16:52:09.727818 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:09.727791 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:09.727895 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:09.727876 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:09.727938 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:09.727910 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:10.734998 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:10.734956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" event={"ID":"ec691fc7-c08a-41c0-a20e-23e55007b1ce","Type":"ContainerStarted","Data":"76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650"} Jul 22 16:52:11.453640 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:11.453597 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:52:11.453876 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:11.453857 2574 patch_prober.go:28] interesting pod/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 22 16:52:11.453931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:11.453899 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 22 16:52:12.453791 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:12.453749 2574 patch_prober.go:28] interesting pod/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 22 16:52:12.454220 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:12.453818 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 22 16:52:13.453687 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:13.453648 2574 patch_prober.go:28] interesting pod/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 22 16:52:13.453885 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:13.453708 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 22 16:52:14.453524 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:14.453474 2574 patch_prober.go:28] interesting pod/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 22 16:52:14.453712 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:14.453567 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 22 16:52:15.457341 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:15.457311 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:52:15.457783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:15.457581 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:52:15.458382 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:15.458362 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:52:15.729713 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:15.729623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:15.827564 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:15.827517 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:20.040309 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040271 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567"] Jul 22 16:52:20.040685 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040606 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" Jul 22 16:52:20.040685 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040618 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" Jul 22 16:52:20.040685 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040634 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" Jul 22 16:52:20.040685 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040640 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" Jul 22 16:52:20.040989 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040696 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" Jul 22 16:52:20.040989 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.040706 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="57813375-26c9-46d3-affb-011f24f05f01" containerName="istio-proxy" Jul 22 16:52:20.044313 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.044295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:20.046701 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.046679 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 16:52:20.046807 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.046734 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\"" Jul 22 16:52:20.050583 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.050557 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567"] Jul 22 16:52:20.124799 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.124759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/754e8135-a52e-4f15-8fc8-14f69dc89cde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-66fe2bd0-94567\" (UID: \"754e8135-a52e-4f15-8fc8-14f69dc89cde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:20.226011 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.225975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/754e8135-a52e-4f15-8fc8-14f69dc89cde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-66fe2bd0-94567\" (UID: \"754e8135-a52e-4f15-8fc8-14f69dc89cde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:20.226604 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.226584 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/754e8135-a52e-4f15-8fc8-14f69dc89cde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-66fe2bd0-94567\" (UID: \"754e8135-a52e-4f15-8fc8-14f69dc89cde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:20.355995 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.355915 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:20.486594 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.486440 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567"] Jul 22 16:52:20.488685 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:52:20.488655 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754e8135_a52e_4f15_8fc8_14f69dc89cde.slice/crio-d27571f12403383648036ef9322b9e46f718dae9c8970617995e6bef01097ec6 WatchSource:0}: Error finding container d27571f12403383648036ef9322b9e46f718dae9c8970617995e6bef01097ec6: Status 404 returned error can't find the container with id d27571f12403383648036ef9322b9e46f718dae9c8970617995e6bef01097ec6 Jul 22 16:52:20.782374 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.782337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" event={"ID":"754e8135-a52e-4f15-8fc8-14f69dc89cde","Type":"ContainerStarted","Data":"f0d33fa9d1f5789d276229f2953a17815682ff317095f076f02c5f8f25309a60"} Jul 22 16:52:20.782601 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.782423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" event={"ID":"754e8135-a52e-4f15-8fc8-14f69dc89cde","Type":"ContainerStarted","Data":"d27571f12403383648036ef9322b9e46f718dae9c8970617995e6bef01097ec6"} Jul 22 16:52:20.801672 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:20.801613 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" podStartSLOduration=0.80159554 podStartE2EDuration="801.59554ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:52:20.800318562 +0000 UTC m=+1877.553254713" watchObservedRunningTime="2026-07-22 16:52:20.80159554 +0000 UTC m=+1877.554531690" Jul 22 16:52:21.790887 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:21.790829 2574 generic.go:356] "Generic (PLEG): container finished" podID="754e8135-a52e-4f15-8fc8-14f69dc89cde" containerID="f0d33fa9d1f5789d276229f2953a17815682ff317095f076f02c5f8f25309a60" exitCode=0 Jul 22 16:52:21.791272 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:21.790894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" event={"ID":"754e8135-a52e-4f15-8fc8-14f69dc89cde","Type":"ContainerDied","Data":"f0d33fa9d1f5789d276229f2953a17815682ff317095f076f02c5f8f25309a60"} Jul 22 16:52:22.927612 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:22.927584 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:22.951255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:22.951229 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/754e8135-a52e-4f15-8fc8-14f69dc89cde-maas-api-service-ca\") pod \"754e8135-a52e-4f15-8fc8-14f69dc89cde\" (UID: \"754e8135-a52e-4f15-8fc8-14f69dc89cde\") " Jul 22 16:52:22.951608 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:22.951587 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/754e8135-a52e-4f15-8fc8-14f69dc89cde-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "754e8135-a52e-4f15-8fc8-14f69dc89cde" (UID: "754e8135-a52e-4f15-8fc8-14f69dc89cde"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:52:23.052218 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:23.052125 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/754e8135-a52e-4f15-8fc8-14f69dc89cde-maas-api-service-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:23.800553 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:23.800528 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" Jul 22 16:52:23.800729 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:23.800520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567" event={"ID":"754e8135-a52e-4f15-8fc8-14f69dc89cde","Type":"ContainerDied","Data":"d27571f12403383648036ef9322b9e46f718dae9c8970617995e6bef01097ec6"} Jul 22 16:52:23.800729 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:23.800653 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d27571f12403383648036ef9322b9e46f718dae9c8970617995e6bef01097ec6" Jul 22 16:52:30.585559 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:30.585465 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:35.124292 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:35.124256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:35.141616 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:35.141585 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567"] Jul 22 16:52:35.144684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:35.144663 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-66fe2bd0-94567"] Jul 22 16:52:36.103075 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:36.103041 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754e8135-a52e-4f15-8fc8-14f69dc89cde" path="/var/lib/kubelet/pods/754e8135-a52e-4f15-8fc8-14f69dc89cde/volumes" Jul 22 16:52:36.492355 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:36.492319 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf"] Jul 22 16:52:36.492860 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:36.492556 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" containerID="cri-o://76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650" gracePeriod=30 Jul 22 16:52:36.514664 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:36.514634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:36.776183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:36.776078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:37.029931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.029806 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:37.347552 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.347471 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz"] Jul 22 16:52:37.347971 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.347950 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754e8135-a52e-4f15-8fc8-14f69dc89cde" containerName="revoke-keys" Jul 22 16:52:37.347971 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.347972 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="754e8135-a52e-4f15-8fc8-14f69dc89cde" containerName="revoke-keys" Jul 22 16:52:37.348245 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.348049 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="754e8135-a52e-4f15-8fc8-14f69dc89cde" containerName="revoke-keys" Jul 22 16:52:37.351101 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.351082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.353581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.353563 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d9102441-openshift-default-dockercfg-4g2mv\"" Jul 22 16:52:37.372743 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.372718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:37.372965 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.372762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz"] Jul 22 16:52:37.481739 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-token\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.481739 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af54aa5b-7309-409d-b0c5-299389ca1b9d-istiod-ca-cert\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2szj7\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-kube-api-access-2szj7\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-podinfo\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-data\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-socket\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.481980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-certs\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.482004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-credential-socket\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.482060 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.482020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-envoy\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583326 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-credential-socket\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583326 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-envoy\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-token\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af54aa5b-7309-409d-b0c5-299389ca1b9d-istiod-ca-cert\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2szj7\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-kube-api-access-2szj7\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-podinfo\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-data\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-socket\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583754 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-credential-socket\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.583920 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.583828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-certs\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.584328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.584088 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-socket\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.584328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.584171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-data\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.584328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.584177 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-certs\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.584328 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.584292 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af54aa5b-7309-409d-b0c5-299389ca1b9d-istiod-ca-cert\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.586148 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.586126 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-envoy\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.586470 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.586451 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-podinfo\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.592671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.592648 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2szj7\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-kube-api-access-2szj7\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.593031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.593007 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-token\") pod \"e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.662146 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.662053 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:37.799583 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.799549 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz"] Jul 22 16:52:37.802035 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:52:37.802008 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf54aa5b_7309_409d_b0c5_299389ca1b9d.slice/crio-aec88270df823e7ceb11f1dec952c3e942ca1af47f44b17ae4178eeff1b659e0 WatchSource:0}: Error finding container aec88270df823e7ceb11f1dec952c3e942ca1af47f44b17ae4178eeff1b659e0: Status 404 returned error can't find the container with id aec88270df823e7ceb11f1dec952c3e942ca1af47f44b17ae4178eeff1b659e0 Jul 22 16:52:37.805119 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.805042 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:37.805244 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.805193 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:37.805314 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.805246 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:37.861061 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.861031 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" event={"ID":"af54aa5b-7309-409d-b0c5-299389ca1b9d","Type":"ContainerStarted","Data":"aec88270df823e7ceb11f1dec952c3e942ca1af47f44b17ae4178eeff1b659e0"} Jul 22 16:52:37.990815 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:37.990778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:38.867030 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:38.866984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" event={"ID":"af54aa5b-7309-409d-b0c5-299389ca1b9d","Type":"ContainerStarted","Data":"201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c"} Jul 22 16:52:38.889030 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:38.888982 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podStartSLOduration=1.8889652780000001 podStartE2EDuration="1.888965278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:52:38.887802811 +0000 UTC m=+1895.640738962" watchObservedRunningTime="2026-07-22 16:52:38.888965278 +0000 UTC m=+1895.641901428" Jul 22 16:52:39.663334 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:39.663290 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:39.668552 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:39.668529 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:39.871319 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:39.871284 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:39.872215 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:39.872198 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:40.242985 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:40.242956 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:40.344572 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:40.344532 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:40.415520 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:40.415394 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:40.845096 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:40.845015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:40.959783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:40.959754 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:41.059370 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.059338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:52:41.735314 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.735289 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:52:41.825464 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825375 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj46f\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-kube-api-access-kj46f\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825464 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825436 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-envoy\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825464 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825460 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istiod-ca-cert\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825487 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-data\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825542 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-socket\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825569 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-certs\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825621 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-podinfo\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825653 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-token\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.825750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825697 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-credential-socket\") pod \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\" (UID: \"ec691fc7-c08a-41c0-a20e-23e55007b1ce\") " Jul 22 16:52:41.826078 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825886 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:52:41.826078 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.825976 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:52:41.826191 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.826095 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.826191 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.826113 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.826293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.826198 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:52:41.826293 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.826238 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:52:41.826554 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.826533 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:52:41.827755 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.827726 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:52:41.827905 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.827821 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-kube-api-access-kj46f" (OuterVolumeSpecName: "kube-api-access-kj46f") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "kube-api-access-kj46f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:52:41.828306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.828271 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:52:41.828306 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.828286 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec691fc7-c08a-41c0-a20e-23e55007b1ce" (UID: "ec691fc7-c08a-41c0-a20e-23e55007b1ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 16:52:41.881825 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.881788 2574 generic.go:356] "Generic (PLEG): container finished" podID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerID="76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650" exitCode=0 Jul 22 16:52:41.882016 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.881869 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" Jul 22 16:52:41.882016 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.881887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" event={"ID":"ec691fc7-c08a-41c0-a20e-23e55007b1ce","Type":"ContainerDied","Data":"76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650"} Jul 22 16:52:41.882016 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.881945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf" event={"ID":"ec691fc7-c08a-41c0-a20e-23e55007b1ce","Type":"ContainerDied","Data":"2228f4043d9abf88ca25f31adda13822be6aa656876910a239a9fefe438da48c"} Jul 22 16:52:41.882016 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.881974 2574 scope.go:117] "RemoveContainer" containerID="76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650" Jul 22 16:52:41.890799 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.890777 2574 scope.go:117] "RemoveContainer" containerID="2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55" Jul 22 16:52:41.898427 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.898408 2574 scope.go:117] "RemoveContainer" containerID="76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650" Jul 22 16:52:41.898673 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:52:41.898654 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650\": container with ID starting with 76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650 not found: ID does not exist" containerID="76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650" Jul 22 16:52:41.898720 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.898681 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650"} err="failed to get container status \"76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650\": rpc error: code = NotFound desc = could not find container \"76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650\": container with ID starting with 76a79a28039499e0a65ee3375a2b261d0f0f0ebfee279e1f6605acbb45124650 not found: ID does not exist" Jul 22 16:52:41.898720 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.898696 2574 scope.go:117] "RemoveContainer" containerID="2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55" Jul 22 16:52:41.898988 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:52:41.898970 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55\": container with ID starting with 2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55 not found: ID does not exist" containerID="2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55" Jul 22 16:52:41.899037 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.898994 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55"} err="failed to get container status \"2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55\": rpc error: code = NotFound desc = could not find container \"2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55\": container with ID starting with 2d7d765cae8376b23580a48ce0a40cf2b51433dc53466167599fff67d0a33f55 not found: ID does not exist" Jul 22 16:52:41.904511 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.904487 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf"] Jul 22 16:52:41.913241 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.913208 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-66fe2bd0-openshift-default-7d674f69bf-t2csf"] Jul 22 16:52:41.926528 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926499 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.926528 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926528 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj46f\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-kube-api-access-kj46f\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.926684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926541 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.926684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926550 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.926684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926558 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec691fc7-c08a-41c0-a20e-23e55007b1ce-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.926684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926566 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:41.926684 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:41.926573 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec691fc7-c08a-41c0-a20e-23e55007b1ce-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:52:42.103984 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:42.103906 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" path="/var/lib/kubelet/pods/ec691fc7-c08a-41c0-a20e-23e55007b1ce/volumes" Jul 22 16:52:53.937954 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:53.937920 2574 generic.go:356] "Generic (PLEG): container finished" podID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerID="201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c" exitCode=0 Jul 22 16:52:53.938363 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:53.937973 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" event={"ID":"af54aa5b-7309-409d-b0c5-299389ca1b9d","Type":"ContainerDied","Data":"201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c"} Jul 22 16:52:53.938363 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:53.938305 2574 scope.go:117] "RemoveContainer" containerID="201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c" Jul 22 16:52:53.939246 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:53.939217 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:53.939298 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:53.939285 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:53.939333 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:53.939319 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:52:54.871808 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:54.871769 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:54.944047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:54.944014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" event={"ID":"af54aa5b-7309-409d-b0c5-299389ca1b9d","Type":"ContainerStarted","Data":"4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058"} Jul 22 16:52:55.662683 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:55.662638 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:52:55.663726 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:55.663698 2574 patch_prober.go:28] interesting pod/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 22 16:52:55.663863 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:55.663760 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 22 16:52:56.662861 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:56.662797 2574 patch_prober.go:28] interesting pod/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 22 16:52:56.663362 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:56.662906 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 22 16:52:57.662979 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:57.662944 2574 patch_prober.go:28] interesting pod/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 22 16:52:57.663373 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:57.663011 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 22 16:52:58.663263 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:58.663221 2574 patch_prober.go:28] interesting pod/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 22 16:52:58.663740 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:58.663288 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 22 16:52:59.663093 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:59.663056 2574 patch_prober.go:28] interesting pod/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 22 16:52:59.663281 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:52:59.663128 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 22 16:53:00.666824 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:00.666785 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:53:00.667321 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:00.667299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:53:00.668001 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:00.667980 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:53:03.490944 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:03.490911 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:15.877513 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:15.877473 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:20.359711 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:20.359672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:20.503314 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:20.503276 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz"] Jul 22 16:53:20.503550 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:20.503526 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" containerID="cri-o://4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058" gracePeriod=30 Jul 22 16:53:20.528358 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:20.528327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:20.800219 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:20.800183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:21.387330 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:21.387300 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:21.495962 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:21.495928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:21.641682 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:21.641599 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:23.219041 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:23.219003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:25.759661 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.759636 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:53:25.930421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930396 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-socket\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930597 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930435 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2szj7\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-kube-api-access-2szj7\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930597 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930468 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-data\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930597 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930491 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-envoy\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930608 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-token\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930663 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-credential-socket\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930727 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-podinfo\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.930750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930737 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:53:25.931002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930791 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-certs\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.931002 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.930830 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af54aa5b-7309-409d-b0c5-299389ca1b9d-istiod-ca-cert\") pod \"af54aa5b-7309-409d-b0c5-299389ca1b9d\" (UID: \"af54aa5b-7309-409d-b0c5-299389ca1b9d\") " Jul 22 16:53:25.931124 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.931043 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:53:25.931180 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.931162 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:25.931235 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.931180 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:25.931295 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.931275 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af54aa5b-7309-409d-b0c5-299389ca1b9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:53:25.931374 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.931349 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:53:25.931516 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.931490 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:53:25.932905 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.932870 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:53:25.932905 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.932882 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-kube-api-access-2szj7" (OuterVolumeSpecName: "kube-api-access-2szj7") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "kube-api-access-2szj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:53:25.932905 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.932888 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:53:25.933140 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:25.933045 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af54aa5b-7309-409d-b0c5-299389ca1b9d" (UID: "af54aa5b-7309-409d-b0c5-299389ca1b9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 16:53:26.032581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032547 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af54aa5b-7309-409d-b0c5-299389ca1b9d-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.032581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032577 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2szj7\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-kube-api-access-2szj7\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.032581 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032588 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.032983 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032596 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.032983 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032604 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.032983 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032615 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af54aa5b-7309-409d-b0c5-299389ca1b9d-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.032983 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.032626 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af54aa5b-7309-409d-b0c5-299389ca1b9d-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:53:26.091187 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.091144 2574 generic.go:356] "Generic (PLEG): container finished" podID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerID="4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058" exitCode=0 Jul 22 16:53:26.091187 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.091189 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" Jul 22 16:53:26.091386 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.091221 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" event={"ID":"af54aa5b-7309-409d-b0c5-299389ca1b9d","Type":"ContainerDied","Data":"4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058"} Jul 22 16:53:26.091386 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.091273 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz" event={"ID":"af54aa5b-7309-409d-b0c5-299389ca1b9d","Type":"ContainerDied","Data":"aec88270df823e7ceb11f1dec952c3e942ca1af47f44b17ae4178eeff1b659e0"} Jul 22 16:53:26.091386 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.091296 2574 scope.go:117] "RemoveContainer" containerID="4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058" Jul 22 16:53:26.100009 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.099992 2574 scope.go:117] "RemoveContainer" containerID="201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c" Jul 22 16:53:26.107735 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.107714 2574 scope.go:117] "RemoveContainer" containerID="4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058" Jul 22 16:53:26.108031 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:53:26.108011 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058\": container with ID starting with 4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058 not found: ID does not exist" containerID="4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058" Jul 22 16:53:26.108096 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.108040 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058"} err="failed to get container status \"4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058\": rpc error: code = NotFound desc = could not find container \"4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058\": container with ID starting with 4bfddd6fc75f0fdab82a2cd9ffe52bd2c958f4091bb25948e2432f0c8f795058 not found: ID does not exist" Jul 22 16:53:26.108096 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.108057 2574 scope.go:117] "RemoveContainer" containerID="201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c" Jul 22 16:53:26.108290 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:53:26.108275 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c\": container with ID starting with 201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c not found: ID does not exist" containerID="201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c" Jul 22 16:53:26.108327 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.108293 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c"} err="failed to get container status \"201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c\": rpc error: code = NotFound desc = could not find container \"201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c\": container with ID starting with 201dc7861b0ceb365ce28157b791787fc09d8bc22e7277303be25ac6718ac44c not found: ID does not exist" Jul 22 16:53:26.117162 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.117132 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz"] Jul 22 16:53:26.125695 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:26.125667 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d9102441-openshift-default-7f7dbfcbc-pjwcz"] Jul 22 16:53:28.107565 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:28.107528 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" path="/var/lib/kubelet/pods/af54aa5b-7309-409d-b0c5-299389ca1b9d/volumes" Jul 22 16:53:29.446379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:29.446346 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:29.546582 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:29.546553 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:29.645982 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:29.645950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:29.748351 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:29.748269 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:30.247388 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:30.247350 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:31.490493 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:31.490466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:31.590928 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:31.590883 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:53:56.320221 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:53:56.320135 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:02.630999 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:02.630961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:02.735656 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:02.735628 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:02.832613 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:02.832584 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:18.808912 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:18.808883 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:25.240592 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:25.240554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:25.304929 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:25.304895 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:26.793379 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:26.793346 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:36.067820 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:36.067781 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:36.981809 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:36.981769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:43.891298 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:43.891262 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:43.997797 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:43.997757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:44.095781 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:44.095733 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:44.192260 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:44.192236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:45.127816 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:45.127781 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:45.229193 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:45.229158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:45.340224 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:45.340195 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:47.257937 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:47.257908 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:53.329620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:53.329583 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:53.429819 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:53.429791 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:54:54.087360 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:54:54.087324 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:00.827415 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:00.827382 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:00.892247 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:00.892216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:01.140655 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.140555 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:01.438958 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.438893 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl"] Jul 22 16:55:01.439366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439340 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" Jul 22 16:55:01.439545 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439531 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" Jul 22 16:55:01.439649 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439638 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" Jul 22 16:55:01.439726 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439717 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" Jul 22 16:55:01.439815 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439792 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" Jul 22 16:55:01.439815 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439806 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" Jul 22 16:55:01.439990 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439936 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" Jul 22 16:55:01.439990 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439948 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" Jul 22 16:55:01.439990 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.439961 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" Jul 22 16:55:01.443105 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.443087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.445758 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.445740 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b7a2b4dd-openshift-default-dockercfg-5xqwz\"" Jul 22 16:55:01.473109 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.473076 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl"] Jul 22 16:55:01.473577 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.473551 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:01.565965 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.565934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-data\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.565990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxpl7\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-kube-api-access-wxpl7\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-certs\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-podinfo\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-credential-socket\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566178 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-envoy\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-socket\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-token\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.566412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.566261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istiod-ca-cert\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666773 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxpl7\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-kube-api-access-wxpl7\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-certs\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-podinfo\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-credential-socket\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-envoy\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-socket\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.666976 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-token\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.667307 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.666991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istiod-ca-cert\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.667307 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.667055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-data\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.667413 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.667322 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-credential-socket\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.667799 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.667772 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-certs\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.667974 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.667404 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-socket\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.668116 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.668093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-data\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.668385 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.668354 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istiod-ca-cert\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.674701 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.674674 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-podinfo\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.675040 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.675019 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-envoy\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.676637 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.676614 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-token\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.677768 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.677747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxpl7\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-kube-api-access-wxpl7\") pod \"e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.753990 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.753891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:01.896022 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.895994 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl"] Jul 22 16:55:01.898151 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:55:01.898127 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e663a4_68d4_47b7_b641_cfcbc1f007c2.slice/crio-6fcbfe30e75d00f2b4f1b5e14ef59bec480ebd37881369db9504b75153ada6fa WatchSource:0}: Error finding container 6fcbfe30e75d00f2b4f1b5e14ef59bec480ebd37881369db9504b75153ada6fa: Status 404 returned error can't find the container with id 6fcbfe30e75d00f2b4f1b5e14ef59bec480ebd37881369db9504b75153ada6fa Jul 22 16:55:01.900181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.900141 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:01.900277 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.900220 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:01.900277 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.900265 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:01.948777 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:01.948751 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:02.489222 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:02.489181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" event={"ID":"d4e663a4-68d4-47b7-b641-cfcbc1f007c2","Type":"ContainerStarted","Data":"18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7"} Jul 22 16:55:02.489407 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:02.489239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" event={"ID":"d4e663a4-68d4-47b7-b641-cfcbc1f007c2","Type":"ContainerStarted","Data":"6fcbfe30e75d00f2b4f1b5e14ef59bec480ebd37881369db9504b75153ada6fa"} Jul 22 16:55:02.514393 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:02.514340 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podStartSLOduration=1.514320852 podStartE2EDuration="1.514320852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:55:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:55:02.511947426 +0000 UTC m=+2039.264883580" watchObservedRunningTime="2026-07-22 16:55:02.514320852 +0000 UTC m=+2039.267257002" Jul 22 16:55:02.754754 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:02.754660 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:02.759958 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:02.759930 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:03.494781 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:03.494750 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:03.495672 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:03.495653 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:04.522430 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:04.522399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:04.629562 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:04.629533 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:04.727545 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:04.727515 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:04.975210 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:04.975176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:05.309655 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:05.309564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:05.410040 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:05.410011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:09.086937 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:09.086906 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:09.884670 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:09.884636 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:09.986324 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:09.986292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:10.392231 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:10.392199 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:16.428866 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:16.428816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:16.489327 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:16.489295 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:19.537063 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:19.537023 2574 patch_prober.go:28] interesting pod/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 16:55:19.537447 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:19.537134 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 16:55:20.579147 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:20.579061 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerID="18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7" exitCode=0 Jul 22 16:55:20.579537 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:20.579139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" event={"ID":"d4e663a4-68d4-47b7-b641-cfcbc1f007c2","Type":"ContainerDied","Data":"18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7"} Jul 22 16:55:20.579537 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:20.579517 2574 scope.go:117] "RemoveContainer" containerID="18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7" Jul 22 16:55:20.580508 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:20.580473 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:20.580580 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:20.580563 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:20.580628 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:20.580612 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:21.585769 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:21.585735 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" event={"ID":"d4e663a4-68d4-47b7-b641-cfcbc1f007c2","Type":"ContainerStarted","Data":"1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452"} Jul 22 16:55:21.754917 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:21.754881 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:21.755168 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:21.755146 2574 patch_prober.go:28] interesting pod/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 22 16:55:21.755229 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:21.755205 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 22 16:55:22.754487 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:22.754450 2574 patch_prober.go:28] interesting pod/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 22 16:55:22.754922 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:22.754516 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 22 16:55:23.755255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:23.755212 2574 patch_prober.go:28] interesting pod/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 22 16:55:23.755664 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:23.755279 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 22 16:55:24.755047 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:24.755007 2574 patch_prober.go:28] interesting pod/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 22 16:55:24.755240 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:24.755072 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 22 16:55:25.757772 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:25.757698 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:25.758148 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:25.758096 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:25.758687 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:25.758669 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:27.317528 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:27.317496 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:31.897278 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:31.897245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:32.349380 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:32.349345 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:38.508483 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:38.508440 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:38.575542 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:38.575509 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:38.789800 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:38.789714 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl"] Jul 22 16:55:38.789977 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:38.789943 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" containerID="cri-o://1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452" gracePeriod=30 Jul 22 16:55:38.803421 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:38.803395 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:39.046357 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:39.046267 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:39.180694 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:39.180657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:39.278615 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:39.278578 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:39.431183 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:39.431150 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:40.760606 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:40.760567 2574 patch_prober.go:28] interesting pod/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 22 16:55:40.761084 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:40.760628 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 16:55:44.043217 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.043191 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:44.146112 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146043 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-certs\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146112 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146072 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxpl7\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-kube-api-access-wxpl7\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146112 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146099 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-socket\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146123 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-podinfo\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146158 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istiod-ca-cert\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146184 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-token\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146220 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-credential-socket\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146259 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-envoy\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146327 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-data\") pod \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\" (UID: \"d4e663a4-68d4-47b7-b641-cfcbc1f007c2\") " Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146322 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:55:44.146395 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146346 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:55:44.146854 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146539 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:55:44.146854 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146570 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.146854 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146604 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.147026 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.146882 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:55:44.147181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.147161 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:55:44.148412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.148389 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:55:44.148412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.148404 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-kube-api-access-wxpl7" (OuterVolumeSpecName: "kube-api-access-wxpl7") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "kube-api-access-wxpl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:55:44.148685 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.148662 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 16:55:44.148757 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.148679 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4e663a4-68d4-47b7-b641-cfcbc1f007c2" (UID: "d4e663a4-68d4-47b7-b641-cfcbc1f007c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:55:44.247882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247858 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxpl7\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-kube-api-access-wxpl7\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.247882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247880 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.248031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247889 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.248031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247897 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.248031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247905 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.248031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247913 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.248031 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.247922 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4e663a4-68d4-47b7-b641-cfcbc1f007c2-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:55:44.694750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.694718 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerID="1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452" exitCode=0 Jul 22 16:55:44.694981 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.694766 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" Jul 22 16:55:44.694981 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.694789 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" event={"ID":"d4e663a4-68d4-47b7-b641-cfcbc1f007c2","Type":"ContainerDied","Data":"1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452"} Jul 22 16:55:44.694981 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.694861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl" event={"ID":"d4e663a4-68d4-47b7-b641-cfcbc1f007c2","Type":"ContainerDied","Data":"6fcbfe30e75d00f2b4f1b5e14ef59bec480ebd37881369db9504b75153ada6fa"} Jul 22 16:55:44.694981 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.694892 2574 scope.go:117] "RemoveContainer" containerID="1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452" Jul 22 16:55:44.703402 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.703386 2574 scope.go:117] "RemoveContainer" containerID="18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7" Jul 22 16:55:44.713044 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.713021 2574 scope.go:117] "RemoveContainer" containerID="1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452" Jul 22 16:55:44.713450 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:55:44.713427 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452\": container with ID starting with 1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452 not found: ID does not exist" containerID="1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452" Jul 22 16:55:44.713511 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.713462 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452"} err="failed to get container status \"1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452\": rpc error: code = NotFound desc = could not find container \"1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452\": container with ID starting with 1ca66b94838e677265ece385089327ac90fd0878e14f6711cdfb8cc4a9e8c452 not found: ID does not exist" Jul 22 16:55:44.713511 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.713485 2574 scope.go:117] "RemoveContainer" containerID="18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7" Jul 22 16:55:44.713776 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:55:44.713757 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7\": container with ID starting with 18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7 not found: ID does not exist" containerID="18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7" Jul 22 16:55:44.713873 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.713784 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7"} err="failed to get container status \"18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7\": rpc error: code = NotFound desc = could not find container \"18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7\": container with ID starting with 18a9926e2e0182acebc5d86d736bb1538b5f0f87121e8c6d28f83195312356d7 not found: ID does not exist" Jul 22 16:55:44.717537 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.717515 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl"] Jul 22 16:55:44.721115 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:44.721095 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b7a2b4dd-openshift-default-99f97f7f5-5sjgl"] Jul 22 16:55:45.188303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:45.188274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:45.287828 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:45.287798 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:45.388464 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:45.388435 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:45.449643 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:45.449565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:45.614648 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:45.614623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:46.103672 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:46.103631 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" path="/var/lib/kubelet/pods/d4e663a4-68d4-47b7-b641-cfcbc1f007c2/volumes" Jul 22 16:55:51.846810 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:51.846770 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:51.915853 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:51.915815 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:59.032218 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.032173 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:59.345750 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.345660 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft"] Jul 22 16:55:59.346181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346147 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" Jul 22 16:55:59.346181 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346173 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" Jul 22 16:55:59.346400 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346198 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" Jul 22 16:55:59.346400 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346208 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec691fc7-c08a-41c0-a20e-23e55007b1ce" containerName="istio-proxy" Jul 22 16:55:59.346400 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346299 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" Jul 22 16:55:59.346400 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346311 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" Jul 22 16:55:59.346400 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.346320 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="af54aa5b-7309-409d-b0c5-299389ca1b9d" containerName="istio-proxy" Jul 22 16:55:59.350799 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.350781 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.353611 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.353593 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-db88bcf6-openshift-default-dockercfg-jg8lq\"" Jul 22 16:55:59.360352 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.360327 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft"] Jul 22 16:55:59.381768 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.381720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrqs4\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-kube-api-access-jrqs4\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.381768 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.381774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-credential-socket\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382038 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.381859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3587c87-8709-4a38-b58b-e9c56f11c46e-istiod-ca-cert\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382038 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.381935 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-podinfo\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382038 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.381962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-certs\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382038 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.382004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-token\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382264 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.382047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-envoy\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382264 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.382107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-data\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382264 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.382157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-socket\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.382798 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.382769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:59.483427 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrqs4\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-kube-api-access-jrqs4\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483427 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-credential-socket\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3587c87-8709-4a38-b58b-e9c56f11c46e-istiod-ca-cert\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-podinfo\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-certs\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-token\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-envoy\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.483782 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-data\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.484154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483910 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-credential-socket\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.484154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.483951 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-certs\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.484154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.484036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-socket\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.484154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.484083 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-socket\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.484154 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.484148 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-data\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.484545 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.484523 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3587c87-8709-4a38-b58b-e9c56f11c46e-istiod-ca-cert\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.486221 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.486202 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-podinfo\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.486308 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.486222 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-envoy\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.493193 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.493165 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-token\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.493316 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.493296 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrqs4\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-kube-api-access-jrqs4\") pod \"e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.662109 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.662012 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:55:59.733008 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.732978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:55:59.805488 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.805435 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft"] Jul 22 16:55:59.808130 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:55:59.808093 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3587c87_8709_4a38_b58b_e9c56f11c46e.slice/crio-66c4d0ba31e2b8ebf89b80dd442b09578cc0686308f98716a087772a2ae74b4c WatchSource:0}: Error finding container 66c4d0ba31e2b8ebf89b80dd442b09578cc0686308f98716a087772a2ae74b4c: Status 404 returned error can't find the container with id 66c4d0ba31e2b8ebf89b80dd442b09578cc0686308f98716a087772a2ae74b4c Jul 22 16:55:59.810707 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.810659 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:59.810800 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.810747 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:55:59.810800 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:55:59.810793 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:56:00.763811 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:00.763773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" event={"ID":"c3587c87-8709-4a38-b58b-e9c56f11c46e","Type":"ContainerStarted","Data":"516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365"} Jul 22 16:56:00.764237 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:00.763857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" event={"ID":"c3587c87-8709-4a38-b58b-e9c56f11c46e","Type":"ContainerStarted","Data":"66c4d0ba31e2b8ebf89b80dd442b09578cc0686308f98716a087772a2ae74b4c"} Jul 22 16:56:00.785993 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:00.785944 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podStartSLOduration=1.785928938 podStartE2EDuration="1.785928938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:56:00.784249733 +0000 UTC m=+2097.537185896" watchObservedRunningTime="2026-07-22 16:56:00.785928938 +0000 UTC m=+2097.538865087" Jul 22 16:56:01.662416 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:01.662367 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:01.667767 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:01.667739 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:01.768478 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:01.768443 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:01.769410 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:01.769391 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:02.793732 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:02.793699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:02.889041 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:02.889013 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:03.060934 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:03.060850 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:03.156478 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:03.156449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:03.514897 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:03.514850 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:03.614612 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:03.614583 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:07.349026 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:07.348990 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:17.236710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.236005 2574 patch_prober.go:28] interesting pod/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": read tcp 10.134.0.2:32852->10.134.0.35:15021: read: connection reset by peer" start-of-body= Jul 22 16:56:17.236710 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.236070 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": read tcp 10.134.0.2:32852->10.134.0.35:15021: read: connection reset by peer" Jul 22 16:56:17.842279 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.842248 2574 generic.go:356] "Generic (PLEG): container finished" podID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerID="516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365" exitCode=0 Jul 22 16:56:17.842461 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.842325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" event={"ID":"c3587c87-8709-4a38-b58b-e9c56f11c46e","Type":"ContainerDied","Data":"516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365"} Jul 22 16:56:17.842671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.842658 2574 scope.go:117] "RemoveContainer" containerID="516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365" Jul 22 16:56:17.843649 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.843617 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:56:17.843722 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.843705 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:56:17.843773 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:17.843757 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:56:18.850953 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:18.850922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" event={"ID":"c3587c87-8709-4a38-b58b-e9c56f11c46e","Type":"ContainerStarted","Data":"a7acb82bc6fc52e7aeee0819985806d9023dae05c47784afe93ff5ac83372199"} Jul 22 16:56:19.662888 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:19.662828 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:19.663085 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:19.663062 2574 patch_prober.go:28] interesting pod/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 22 16:56:19.663140 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:19.663111 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 22 16:56:20.662670 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:20.662629 2574 patch_prober.go:28] interesting pod/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 22 16:56:20.663106 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:20.662689 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 22 16:56:21.662549 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:21.662511 2574 patch_prober.go:28] interesting pod/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 22 16:56:21.662732 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:21.662581 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 22 16:56:22.663013 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:22.662978 2574 patch_prober.go:28] interesting pod/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 22 16:56:22.663399 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:22.663030 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 22 16:56:22.923281 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:22.923203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:56:23.666207 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:23.666177 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:23.666573 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:23.666455 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:23.667093 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:23.667074 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:56:51.530252 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.530212 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs"] Jul 22 16:56:51.530883 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.530669 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" Jul 22 16:56:51.530883 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.530691 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e663a4-68d4-47b7-b641-cfcbc1f007c2" containerName="istio-proxy" Jul 22 16:56:51.533456 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.533432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:51.535988 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.535961 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 16:56:51.536134 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.535989 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\"" Jul 22 16:56:51.541892 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.541868 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs"] Jul 22 16:56:51.559593 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.559562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0007ffe0-ca91-407c-919c-a0aae2452c1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs\" (UID: \"0007ffe0-ca91-407c-919c-a0aae2452c1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:51.660861 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.660801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0007ffe0-ca91-407c-919c-a0aae2452c1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs\" (UID: \"0007ffe0-ca91-407c-919c-a0aae2452c1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:51.661430 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.661410 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0007ffe0-ca91-407c-919c-a0aae2452c1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs\" (UID: \"0007ffe0-ca91-407c-919c-a0aae2452c1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:51.846490 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.846404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:51.975906 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.975882 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs"] Jul 22 16:56:51.978565 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:56:51.978533 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0007ffe0_ca91_407c_919c_a0aae2452c1a.slice/crio-9231bcd8e86afbab784d39989fda38ae60b47ea04ebcacdc91576efdc6f168ce WatchSource:0}: Error finding container 9231bcd8e86afbab784d39989fda38ae60b47ea04ebcacdc91576efdc6f168ce: Status 404 returned error can't find the container with id 9231bcd8e86afbab784d39989fda38ae60b47ea04ebcacdc91576efdc6f168ce Jul 22 16:56:51.999323 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:51.999295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" event={"ID":"0007ffe0-ca91-407c-919c-a0aae2452c1a","Type":"ContainerStarted","Data":"9231bcd8e86afbab784d39989fda38ae60b47ea04ebcacdc91576efdc6f168ce"} Jul 22 16:56:53.004681 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:53.004644 2574 generic.go:356] "Generic (PLEG): container finished" podID="0007ffe0-ca91-407c-919c-a0aae2452c1a" containerID="e562fb6ba3b33c1b9dbe59f134a843193714a779d5c30782d2f924a0a9181fc7" exitCode=0 Jul 22 16:56:53.005085 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:53.004727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" event={"ID":"0007ffe0-ca91-407c-919c-a0aae2452c1a","Type":"ContainerDied","Data":"e562fb6ba3b33c1b9dbe59f134a843193714a779d5c30782d2f924a0a9181fc7"} Jul 22 16:56:54.138244 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:54.138223 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:54.181364 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:54.181334 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0007ffe0-ca91-407c-919c-a0aae2452c1a-maas-api-service-ca\") pod \"0007ffe0-ca91-407c-919c-a0aae2452c1a\" (UID: \"0007ffe0-ca91-407c-919c-a0aae2452c1a\") " Jul 22 16:56:54.181687 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:54.181667 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0007ffe0-ca91-407c-919c-a0aae2452c1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0007ffe0-ca91-407c-919c-a0aae2452c1a" (UID: "0007ffe0-ca91-407c-919c-a0aae2452c1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:56:54.282263 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:54.282181 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0007ffe0-ca91-407c-919c-a0aae2452c1a-maas-api-service-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:56:55.017713 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:55.017682 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" Jul 22 16:56:55.017713 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:55.017707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs" event={"ID":"0007ffe0-ca91-407c-919c-a0aae2452c1a","Type":"ContainerDied","Data":"9231bcd8e86afbab784d39989fda38ae60b47ea04ebcacdc91576efdc6f168ce"} Jul 22 16:56:55.017946 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:56:55.017748 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9231bcd8e86afbab784d39989fda38ae60b47ea04ebcacdc91576efdc6f168ce" Jul 22 16:57:03.733255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:03.733169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:03.910091 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:03.910063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:04.631874 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:04.631814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:04.727288 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:04.727256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:07.026754 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:07.026726 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:11.615020 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:11.614977 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs"] Jul 22 16:57:11.615489 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:11.615204 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:11.617007 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:11.616986 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db88bcf6-cxggs"] Jul 22 16:57:12.103147 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:12.103114 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0007ffe0-ca91-407c-919c-a0aae2452c1a" path="/var/lib/kubelet/pods/0007ffe0-ca91-407c-919c-a0aae2452c1a/volumes" Jul 22 16:57:14.133351 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:14.133320 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:19.172951 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:19.172916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:56.049199 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:56.049164 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:57:56.791341 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:57:56.791308 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:02.801313 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:02.801277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:02.902426 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:02.902389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:03.096213 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:03.096121 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft"] Jul 22 16:58:03.096383 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:03.096342 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" containerID="cri-o://a7acb82bc6fc52e7aeee0819985806d9023dae05c47784afe93ff5ac83372199" gracePeriod=30 Jul 22 16:58:03.122589 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:03.122555 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:03.409889 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:03.409769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:03.799189 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:03.799156 2574 scope.go:117] "RemoveContainer" containerID="1d3da3510b7219bb07f3e6a64fd254033d520cb197af1fc4e284327f9497c6b3" Jul 22 16:58:04.595374 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:04.595338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:04.696867 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:04.696820 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:04.797486 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:04.797455 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:05.446537 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:05.446496 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:05.587289 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:05.587251 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:05.686271 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:05.686238 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:05.786678 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:05.786578 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:07.394291 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:07.394259 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:08.326882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.326852 2574 generic.go:356] "Generic (PLEG): container finished" podID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerID="a7acb82bc6fc52e7aeee0819985806d9023dae05c47784afe93ff5ac83372199" exitCode=0 Jul 22 16:58:08.326882 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.326868 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" event={"ID":"c3587c87-8709-4a38-b58b-e9c56f11c46e","Type":"ContainerDied","Data":"a7acb82bc6fc52e7aeee0819985806d9023dae05c47784afe93ff5ac83372199"} Jul 22 16:58:08.327094 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.326929 2574 scope.go:117] "RemoveContainer" containerID="516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365" Jul 22 16:58:08.345205 ip-10-0-143-30 kubenswrapper[2574]: E0722 16:58:08.345185 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365\": container with ID starting with 516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365 not found: ID does not exist" containerID="516ffe3da9cddfedd02aed60a603bac6d83dfa6b0908bddc9bd8df7e67e23365" Jul 22 16:58:08.347536 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.347520 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:58:08.507744 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507708 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-certs\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.507744 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507747 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-data\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507793 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrqs4\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-kube-api-access-jrqs4\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507828 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-podinfo\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507913 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-token\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507938 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-credential-socket\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507967 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3587c87-8709-4a38-b58b-e9c56f11c46e-istiod-ca-cert\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.507992 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-socket\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508021 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-envoy\") pod \"c3587c87-8709-4a38-b58b-e9c56f11c46e\" (UID: \"c3587c87-8709-4a38-b58b-e9c56f11c46e\") " Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508035 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508290 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508302 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.508336 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508311 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:58:08.508975 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508373 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3587c87-8709-4a38-b58b-e9c56f11c46e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 16:58:08.509042 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.508980 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:58:08.510170 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.510129 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-kube-api-access-jrqs4" (OuterVolumeSpecName: "kube-api-access-jrqs4") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "kube-api-access-jrqs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:58:08.510285 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.510225 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 16:58:08.510285 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.510236 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 16:58:08.510369 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.510285 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3587c87-8709-4a38-b58b-e9c56f11c46e" (UID: "c3587c87-8709-4a38-b58b-e9c56f11c46e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 16:58:08.609068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609040 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609064 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrqs4\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-kube-api-access-jrqs4\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609075 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609083 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609090 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609099 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3587c87-8709-4a38-b58b-e9c56f11c46e-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609109 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:08.609303 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:08.609116 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3587c87-8709-4a38-b58b-e9c56f11c46e-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 16:58:09.332510 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:09.332479 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" Jul 22 16:58:09.332696 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:09.332504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft" event={"ID":"c3587c87-8709-4a38-b58b-e9c56f11c46e","Type":"ContainerDied","Data":"66c4d0ba31e2b8ebf89b80dd442b09578cc0686308f98716a087772a2ae74b4c"} Jul 22 16:58:09.332696 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:09.332559 2574 scope.go:117] "RemoveContainer" containerID="a7acb82bc6fc52e7aeee0819985806d9023dae05c47784afe93ff5ac83372199" Jul 22 16:58:09.357292 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:09.357265 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft"] Jul 22 16:58:09.361671 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:09.361650 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-db88bcf6-openshift-default-7c5547dcff-qkwft"] Jul 22 16:58:10.104913 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:10.104883 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" path="/var/lib/kubelet/pods/c3587c87-8709-4a38-b58b-e9c56f11c46e/volumes" Jul 22 16:58:10.974366 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:10.974332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:13.485642 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:13.485610 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:13.589962 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:13.589932 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:14.227591 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:14.227561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:20.818251 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:20.818214 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:20.885822 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:20.885792 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:20.977911 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:20.977877 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:21.071301 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:21.071238 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:31.653679 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:31.653598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:32.070518 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:32.070484 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:53.170491 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:53.170458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:59.391123 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:59.391083 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:59.492822 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:59.492789 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:58:59.800285 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:58:59.800253 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:00.131186 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131112 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r"] Jul 22 16:59:00.131412 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131400 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" Jul 22 16:59:00.131465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131414 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" Jul 22 16:59:00.131465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131427 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0007ffe0-ca91-407c-919c-a0aae2452c1a" containerName="revoke-keys" Jul 22 16:59:00.131465 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131432 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0007ffe0-ca91-407c-919c-a0aae2452c1a" containerName="revoke-keys" Jul 22 16:59:00.131570 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131483 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" Jul 22 16:59:00.131570 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131491 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" Jul 22 16:59:00.131570 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.131498 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0007ffe0-ca91-407c-919c-a0aae2452c1a" containerName="revoke-keys" Jul 22 16:59:00.134403 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.134388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.136997 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.136977 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-314e2c-openshift-default-dockercfg-7mjkj\"" Jul 22 16:59:00.147528 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.147506 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r"] Jul 22 16:59:00.156019 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.155996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:00.230740 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.230707 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:00.240944 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.240915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-credential-socket\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241091 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.240947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rff\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-kube-api-access-59rff\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241091 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.240967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-token\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241091 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.240997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-data\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241261 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.241095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istiod-ca-cert\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241261 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.241148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-socket\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241261 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.241174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-podinfo\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241261 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.241213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-envoy\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.241261 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.241241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-certs\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342064 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-envoy\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342064 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-certs\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342323 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-credential-socket\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342323 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rff\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-kube-api-access-59rff\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342323 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-token\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342486 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-data\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342486 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istiod-ca-cert\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342486 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-socket\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342486 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-podinfo\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342699 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-credential-socket\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342699 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342668 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-certs\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.342928 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.342909 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-data\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.343023 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.343000 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-socket\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.343249 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.343231 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istiod-ca-cert\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.344481 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.344465 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-envoy\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.345046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.345029 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-podinfo\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.353573 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.353554 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-token\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.353770 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.353751 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rff\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-kube-api-access-59rff\") pod \"e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.444234 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.444204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:00.580675 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.580647 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r"] Jul 22 16:59:00.582776 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:59:00.582754 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3c0b6c_ac59_4a33_ae1f_888f82ffc82f.slice/crio-c4f62c2ecbdec855f39f8ae86c79b2fd44b3a7e5d95ec13f78f344c11c760f56 WatchSource:0}: Error finding container c4f62c2ecbdec855f39f8ae86c79b2fd44b3a7e5d95ec13f78f344c11c760f56: Status 404 returned error can't find the container with id c4f62c2ecbdec855f39f8ae86c79b2fd44b3a7e5d95ec13f78f344c11c760f56 Jul 22 16:59:00.584786 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.584754 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:00.584890 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.584814 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:00.584890 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:00.584863 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:01.556070 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:01.556030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" event={"ID":"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f","Type":"ContainerStarted","Data":"05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91"} Jul 22 16:59:01.556499 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:01.556143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" event={"ID":"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f","Type":"ContainerStarted","Data":"c4f62c2ecbdec855f39f8ae86c79b2fd44b3a7e5d95ec13f78f344c11c760f56"} Jul 22 16:59:01.578071 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:01.578016 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podStartSLOduration=1.578001347 podStartE2EDuration="1.578001347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:59:01.576409351 +0000 UTC m=+2278.329345514" watchObservedRunningTime="2026-07-22 16:59:01.578001347 +0000 UTC m=+2278.330937555" Jul 22 16:59:02.445390 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:02.445358 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:02.449919 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:02.449897 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:02.560656 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:02.560629 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:02.561608 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:02.561584 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:03.612043 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:03.612010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:03.711680 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:03.711647 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:03.817944 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:03.817911 2574 scope.go:117] "RemoveContainer" containerID="f0d33fa9d1f5789d276229f2953a17815682ff317095f076f02c5f8f25309a60" Jul 22 16:59:03.822619 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:03.822591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:03.923058 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:03.922967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:04.404363 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:04.404334 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:04.504095 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:04.504059 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:08.243959 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.243926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:08.613052 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.612976 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:08.942423 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.942391 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb"] Jul 22 16:59:08.942704 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.942691 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" Jul 22 16:59:08.942749 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.942706 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3587c87-8709-4a38-b58b-e9c56f11c46e" containerName="istio-proxy" Jul 22 16:59:08.945973 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.945950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:08.948239 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.948217 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4b1cd3-openshift-default-dockercfg-fzgwd\"" Jul 22 16:59:08.963348 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.963323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb"] Jul 22 16:59:08.969113 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:08.969084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:09.118783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279a465f-af3d-4d99-8683-1b48377b819f-istio-podinfo\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.118783 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-istio-token\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7st8f\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-kube-api-access-7st8f\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-credential-socket\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-certs\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-envoy\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.118998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-data\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.119023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-socket\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.119046 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.119046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279a465f-af3d-4d99-8683-1b48377b819f-istiod-ca-cert\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.219907 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.219796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7st8f\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-kube-api-access-7st8f\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.219907 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.219863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-credential-socket\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.219907 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.219902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-certs\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220225 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.219966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-envoy\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220225 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-data\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220225 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-socket\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279a465f-af3d-4d99-8683-1b48377b819f-istiod-ca-cert\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279a465f-af3d-4d99-8683-1b48377b819f-istio-podinfo\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-istio-token\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220330 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-credential-socket\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220387 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220373 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-certs\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220620 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220519 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-data\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220682 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220661 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-socket\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.220998 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.220976 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279a465f-af3d-4d99-8683-1b48377b819f-istiod-ca-cert\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.222739 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.222722 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-envoy\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.223015 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.222761 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279a465f-af3d-4d99-8683-1b48377b819f-istio-podinfo\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.228727 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.228705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-istio-token\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.228967 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.228946 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7st8f\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-kube-api-access-7st8f\") pod \"e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.256059 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.256008 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:09.402628 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.402594 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb"] Jul 22 16:59:09.406236 ip-10-0-143-30 kubenswrapper[2574]: W0722 16:59:09.406199 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279a465f_af3d_4d99_8683_1b48377b819f.slice/crio-be0f3432b7220fd1e48ea046e2589548546d8850619e2256abb8c29f5d9f8412 WatchSource:0}: Error finding container be0f3432b7220fd1e48ea046e2589548546d8850619e2256abb8c29f5d9f8412: Status 404 returned error can't find the container with id be0f3432b7220fd1e48ea046e2589548546d8850619e2256abb8c29f5d9f8412 Jul 22 16:59:09.408884 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.408848 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:09.408965 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.408919 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:09.408965 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.408953 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:09.599267 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.598574 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" event={"ID":"279a465f-af3d-4d99-8683-1b48377b819f","Type":"ContainerStarted","Data":"069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4"} Jul 22 16:59:09.599267 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.598635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" event={"ID":"279a465f-af3d-4d99-8683-1b48377b819f","Type":"ContainerStarted","Data":"be0f3432b7220fd1e48ea046e2589548546d8850619e2256abb8c29f5d9f8412"} Jul 22 16:59:09.619780 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:09.619721 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" podStartSLOduration=1.619699537 podStartE2EDuration="1.619699537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:59:09.61811992 +0000 UTC m=+2286.371056083" watchObservedRunningTime="2026-07-22 16:59:09.619699537 +0000 UTC m=+2286.372635688" Jul 22 16:59:10.001034 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:10.000992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:10.256973 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:10.256870 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:10.261681 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:10.261659 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:10.602735 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:10.602657 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:10.603728 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:10.603711 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:11.643718 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:11.643677 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:11.744860 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:11.744801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:11.953858 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:11.953783 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:12.565119 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:12.565086 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:12.661547 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:12.661518 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:16.214720 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:16.214688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:17.562817 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.562731 2574 patch_prober.go:28] interesting pod/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 22 16:59:17.562817 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.562802 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 22 16:59:17.639344 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.639300 2574 generic.go:356] "Generic (PLEG): container finished" podID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerID="05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91" exitCode=0 Jul 22 16:59:17.639546 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.639375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" event={"ID":"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f","Type":"ContainerDied","Data":"05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91"} Jul 22 16:59:17.639931 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.639906 2574 scope.go:117] "RemoveContainer" containerID="05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91" Jul 22 16:59:17.641255 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.641179 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:17.641327 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.641267 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:17.641327 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:17.641313 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:18.651130 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:18.650193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" event={"ID":"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f","Type":"ContainerStarted","Data":"9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432"} Jul 22 16:59:19.445209 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:19.445177 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:19.445623 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:19.445497 2574 patch_prober.go:28] interesting pod/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 22 16:59:19.445780 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:19.445756 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 22 16:59:20.445062 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:20.445022 2574 patch_prober.go:28] interesting pod/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 22 16:59:20.446023 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:20.445572 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 22 16:59:21.444978 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:21.444930 2574 patch_prober.go:28] interesting pod/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 22 16:59:21.445196 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:21.445001 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 22 16:59:22.445402 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:22.445362 2574 patch_prober.go:28] interesting pod/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 22 16:59:22.445907 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:22.445444 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 22 16:59:23.448375 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.448350 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:23.448824 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.448643 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:23.449444 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.449429 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 16:59:23.677068 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.677036 2574 generic.go:356] "Generic (PLEG): container finished" podID="279a465f-af3d-4d99-8683-1b48377b819f" containerID="069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4" exitCode=0 Jul 22 16:59:23.677248 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.677109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" event={"ID":"279a465f-af3d-4d99-8683-1b48377b819f","Type":"ContainerDied","Data":"069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4"} Jul 22 16:59:23.677571 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.677555 2574 scope.go:117] "RemoveContainer" containerID="069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4" Jul 22 16:59:23.678483 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.678454 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:23.678587 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.678536 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:23.678648 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:23.678585 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 16:59:24.683108 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:24.683067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" event={"ID":"279a465f-af3d-4d99-8683-1b48377b819f","Type":"ContainerStarted","Data":"41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715"} Jul 22 16:59:25.257078 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:25.257042 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:25.258120 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:25.258086 2574 patch_prober.go:28] interesting pod/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 22 16:59:25.258268 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:25.258155 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 22 16:59:25.472809 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:25.472770 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:25.569883 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:25.569777 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:25.603009 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:25.602978 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:26.257187 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:26.257145 2574 patch_prober.go:28] interesting pod/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 22 16:59:26.257600 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:26.257237 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 22 16:59:27.256927 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:27.256891 2574 patch_prober.go:28] interesting pod/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 22 16:59:27.257106 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:27.256975 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 22 16:59:28.257310 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:28.257271 2574 patch_prober.go:28] interesting pod/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 22 16:59:28.257729 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:28.257327 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 22 16:59:29.260809 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:29.260775 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:29.261795 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:29.261772 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 16:59:31.526358 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:31.526326 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:33.395351 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:33.395320 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:33.495135 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:33.495107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 16:59:54.620491 ip-10-0-143-30 kubenswrapper[2574]: I0722 16:59:54.620456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:00.132666 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.132584 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7"] Jul 22 17:00:00.136107 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.136085 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v"] Jul 22 17:00:00.136239 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.136193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" Jul 22 17:00:00.138645 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.138617 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\"" Jul 22 17:00:00.139115 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.139086 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" Jul 22 17:00:00.143626 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.143595 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7"] Jul 22 17:00:00.148277 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.148253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v"] Jul 22 17:00:00.150225 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.150207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" Jul 22 17:00:00.158368 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.158347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" Jul 22 17:00:00.323535 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.323512 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v"] Jul 22 17:00:00.325724 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:00:00.325693 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b9d48d_c773_4807_ad9c_28d2570ada66.slice/crio-eb65b21db1b13b82f180ddc8ee9e8bb13e36e4bc51927540c03ca3b9118fa7a5 WatchSource:0}: Error finding container eb65b21db1b13b82f180ddc8ee9e8bb13e36e4bc51927540c03ca3b9118fa7a5: Status 404 returned error can't find the container with id eb65b21db1b13b82f180ddc8ee9e8bb13e36e4bc51927540c03ca3b9118fa7a5 Jul 22 17:00:00.504017 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.503992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7"] Jul 22 17:00:00.506543 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:00:00.506515 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792f19ce_4f6a_4e51_8fba_90574f8cd1be.slice/crio-e8917d5d2507e1f271c97f93b514af84181c55416eec1e2626928eadd73a0240 WatchSource:0}: Error finding container e8917d5d2507e1f271c97f93b514af84181c55416eec1e2626928eadd73a0240: Status 404 returned error can't find the container with id e8917d5d2507e1f271c97f93b514af84181c55416eec1e2626928eadd73a0240 Jul 22 17:00:00.840235 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.840134 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" event={"ID":"d9b9d48d-c773-4807-ad9c-28d2570ada66","Type":"ContainerStarted","Data":"79aa54b63726be07d68b8c6859106c7fd5189ce31ac43d3ae4cee972d21fd329"} Jul 22 17:00:00.840235 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.840192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" event={"ID":"d9b9d48d-c773-4807-ad9c-28d2570ada66","Type":"ContainerStarted","Data":"eb65b21db1b13b82f180ddc8ee9e8bb13e36e4bc51927540c03ca3b9118fa7a5"} Jul 22 17:00:00.841537 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.841503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" event={"ID":"792f19ce-4f6a-4e51-8fba-90574f8cd1be","Type":"ContainerStarted","Data":"f62f4f78637eb591d5db15a62110a86638a133f0271959af95a85f88b5d2e6c0"} Jul 22 17:00:00.841632 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.841559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" event={"ID":"792f19ce-4f6a-4e51-8fba-90574f8cd1be","Type":"ContainerStarted","Data":"e8917d5d2507e1f271c97f93b514af84181c55416eec1e2626928eadd73a0240"} Jul 22 17:00:00.860320 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:00.860264 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" podStartSLOduration=0.860244666 podStartE2EDuration="860.244666ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:00:00.859306756 +0000 UTC m=+2337.612242906" watchObservedRunningTime="2026-07-22 17:00:00.860244666 +0000 UTC m=+2337.613180821" Jul 22 17:00:01.848165 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:01.848066 2574 generic.go:356] "Generic (PLEG): container finished" podID="d9b9d48d-c773-4807-ad9c-28d2570ada66" containerID="79aa54b63726be07d68b8c6859106c7fd5189ce31ac43d3ae4cee972d21fd329" exitCode=0 Jul 22 17:00:01.848543 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:01.848154 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" event={"ID":"d9b9d48d-c773-4807-ad9c-28d2570ada66","Type":"ContainerDied","Data":"79aa54b63726be07d68b8c6859106c7fd5189ce31ac43d3ae4cee972d21fd329"} Jul 22 17:00:01.849671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:01.849652 2574 generic.go:356] "Generic (PLEG): container finished" podID="792f19ce-4f6a-4e51-8fba-90574f8cd1be" containerID="f62f4f78637eb591d5db15a62110a86638a133f0271959af95a85f88b5d2e6c0" exitCode=0 Jul 22 17:00:01.849741 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:01.849681 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" event={"ID":"792f19ce-4f6a-4e51-8fba-90574f8cd1be","Type":"ContainerDied","Data":"f62f4f78637eb591d5db15a62110a86638a133f0271959af95a85f88b5d2e6c0"} Jul 22 17:00:01.865083 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:01.865041 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" podStartSLOduration=1.865027935 podStartE2EDuration="1.865027935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:00:00.878920899 +0000 UTC m=+2337.631857049" watchObservedRunningTime="2026-07-22 17:00:01.865027935 +0000 UTC m=+2338.617964085" Jul 22 17:00:02.980507 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:02.980480 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" Jul 22 17:00:03.016761 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.016738 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" Jul 22 17:00:03.858696 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.858667 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" Jul 22 17:00:03.858936 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.858715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745660-vfzv7" event={"ID":"792f19ce-4f6a-4e51-8fba-90574f8cd1be","Type":"ContainerDied","Data":"e8917d5d2507e1f271c97f93b514af84181c55416eec1e2626928eadd73a0240"} Jul 22 17:00:03.858936 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.858773 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8917d5d2507e1f271c97f93b514af84181c55416eec1e2626928eadd73a0240" Jul 22 17:00:03.859909 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.859887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" event={"ID":"d9b9d48d-c773-4807-ad9c-28d2570ada66","Type":"ContainerDied","Data":"eb65b21db1b13b82f180ddc8ee9e8bb13e36e4bc51927540c03ca3b9118fa7a5"} Jul 22 17:00:03.859909 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.859898 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v" Jul 22 17:00:03.860096 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:03.859921 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb65b21db1b13b82f180ddc8ee9e8bb13e36e4bc51927540c03ca3b9118fa7a5" Jul 22 17:00:25.665395 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:25.665360 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:25.722336 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:25.722303 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:36.511602 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:36.511572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:37.594939 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.594909 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:37.714657 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.714624 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7"] Jul 22 17:00:37.714971 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.714959 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792f19ce-4f6a-4e51-8fba-90574f8cd1be" containerName="cleanup" Jul 22 17:00:37.714971 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.714972 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="792f19ce-4f6a-4e51-8fba-90574f8cd1be" containerName="cleanup" Jul 22 17:00:37.715062 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.714984 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b9d48d-c773-4807-ad9c-28d2570ada66" containerName="cleanup" Jul 22 17:00:37.715062 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.714990 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b9d48d-c773-4807-ad9c-28d2570ada66" containerName="cleanup" Jul 22 17:00:37.715062 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.715041 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b9d48d-c773-4807-ad9c-28d2570ada66" containerName="cleanup" Jul 22 17:00:37.715062 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.715048 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="792f19ce-4f6a-4e51-8fba-90574f8cd1be" containerName="cleanup" Jul 22 17:00:37.718145 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.718126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:37.721058 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.721036 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 17:00:37.721366 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.721352 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xmwmv\"" Jul 22 17:00:37.726220 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.726197 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7"] Jul 22 17:00:37.800257 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.800226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f9db5-eeb2-4427-b123-1e53ea5b300e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7\" (UID: \"aa6f9db5-eeb2-4427-b123-1e53ea5b300e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:37.900796 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.900708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f9db5-eeb2-4427-b123-1e53ea5b300e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7\" (UID: \"aa6f9db5-eeb2-4427-b123-1e53ea5b300e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:37.901336 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:37.901318 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f9db5-eeb2-4427-b123-1e53ea5b300e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7\" (UID: \"aa6f9db5-eeb2-4427-b123-1e53ea5b300e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:38.031505 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:38.031473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:38.166742 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:38.166694 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7"] Jul 22 17:00:38.169102 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:00:38.169073 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6f9db5_eeb2_4427_b123_1e53ea5b300e.slice/crio-7534f6de63634fac3e96d70556d72e7e8c3074b4d790c25897af735907518ff6 WatchSource:0}: Error finding container 7534f6de63634fac3e96d70556d72e7e8c3074b4d790c25897af735907518ff6: Status 404 returned error can't find the container with id 7534f6de63634fac3e96d70556d72e7e8c3074b4d790c25897af735907518ff6 Jul 22 17:00:38.296470 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:38.296440 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:38.408005 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:38.407974 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:39.012208 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:39.012179 2574 generic.go:356] "Generic (PLEG): container finished" podID="aa6f9db5-eeb2-4427-b123-1e53ea5b300e" containerID="cc0ff41234369073088e79cfc43e09909e6debbc99245cafabda89c838731b57" exitCode=0 Jul 22 17:00:39.012591 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:39.012274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" event={"ID":"aa6f9db5-eeb2-4427-b123-1e53ea5b300e","Type":"ContainerDied","Data":"cc0ff41234369073088e79cfc43e09909e6debbc99245cafabda89c838731b57"} Jul 22 17:00:39.012591 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:39.012323 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" event={"ID":"aa6f9db5-eeb2-4427-b123-1e53ea5b300e","Type":"ContainerStarted","Data":"7534f6de63634fac3e96d70556d72e7e8c3074b4d790c25897af735907518ff6"} Jul 22 17:00:40.154524 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:40.154499 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:40.219199 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:40.219166 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f9db5-eeb2-4427-b123-1e53ea5b300e-maas-api-service-ca\") pod \"aa6f9db5-eeb2-4427-b123-1e53ea5b300e\" (UID: \"aa6f9db5-eeb2-4427-b123-1e53ea5b300e\") " Jul 22 17:00:40.219560 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:40.219535 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6f9db5-eeb2-4427-b123-1e53ea5b300e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa6f9db5-eeb2-4427-b123-1e53ea5b300e" (UID: "aa6f9db5-eeb2-4427-b123-1e53ea5b300e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:00:40.320548 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:40.320460 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f9db5-eeb2-4427-b123-1e53ea5b300e-maas-api-service-ca\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:00:41.023085 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:41.023054 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" Jul 22 17:00:41.023241 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:41.023053 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7" event={"ID":"aa6f9db5-eeb2-4427-b123-1e53ea5b300e","Type":"ContainerDied","Data":"7534f6de63634fac3e96d70556d72e7e8c3074b4d790c25897af735907518ff6"} Jul 22 17:00:41.023241 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:41.023180 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7534f6de63634fac3e96d70556d72e7e8c3074b4d790c25897af735907518ff6" Jul 22 17:00:48.201424 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:48.201390 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v"] Jul 22 17:00:48.203668 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:48.203638 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-314e2c-29745660-njr4v"] Jul 22 17:00:48.204571 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:48.204530 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:50.103995 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:50.103961 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9b9d48d-c773-4807-ad9c-28d2570ada66" path="/var/lib/kubelet/pods/d9b9d48d-c773-4807-ad9c-28d2570ada66/volumes" Jul 22 17:00:52.807273 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:52.807241 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:52.815826 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:52.815799 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7"] Jul 22 17:00:52.818906 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:52.818882 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-314e2c-x2jh7"] Jul 22 17:00:53.243511 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:53.243470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:54.103275 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:54.103242 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6f9db5-eeb2-4427-b123-1e53ea5b300e" path="/var/lib/kubelet/pods/aa6f9db5-eeb2-4427-b123-1e53ea5b300e/volumes" Jul 22 17:00:59.362146 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:59.362112 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:59.461676 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:59.461648 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:59.651579 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:59.651500 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r"] Jul 22 17:00:59.651755 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:59.651716 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" containerID="cri-o://9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432" gracePeriod=30 Jul 22 17:00:59.675967 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:59.675937 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:00:59.960252 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:00:59.960227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:00.684777 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:00.684742 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:00.785691 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:00.785659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:04.899010 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.898987 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 17:01:04.942567 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942542 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-socket\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.942737 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942594 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-certs\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.942737 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942622 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-credential-socket\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.942737 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942659 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rff\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-kube-api-access-59rff\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.942737 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942689 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istiod-ca-cert\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.942737 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942704 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-envoy\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.942737 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942725 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-token\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.943069 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942748 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-data\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.943069 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942808 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-podinfo\") pod \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\" (UID: \"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f\") " Jul 22 17:01:04.943069 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942876 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:04.943069 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.942923 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:04.943268 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.943121 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:04.943268 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.943140 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:04.943379 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.943306 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:04.943744 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.943716 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:04.943892 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.943795 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:01:04.945112 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.945095 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:04.945441 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.945417 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-kube-api-access-59rff" (OuterVolumeSpecName: "kube-api-access-59rff") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "kube-api-access-59rff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:01:04.945748 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.945433 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:01:04.945748 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:04.945444 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" (UID: "1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 17:01:05.043937 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043908 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.043937 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043933 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.044115 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043945 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rff\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-kube-api-access-59rff\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.044115 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043955 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.044115 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043964 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.044115 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043972 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.044115 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.043978 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:05.131244 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.131213 2574 generic.go:356] "Generic (PLEG): container finished" podID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerID="9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432" exitCode=0 Jul 22 17:01:05.131370 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.131255 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" Jul 22 17:01:05.131370 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.131295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" event={"ID":"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f","Type":"ContainerDied","Data":"9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432"} Jul 22 17:01:05.131370 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.131343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r" event={"ID":"1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f","Type":"ContainerDied","Data":"c4f62c2ecbdec855f39f8ae86c79b2fd44b3a7e5d95ec13f78f344c11c760f56"} Jul 22 17:01:05.131370 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.131366 2574 scope.go:117] "RemoveContainer" containerID="9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432" Jul 22 17:01:05.140160 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.140144 2574 scope.go:117] "RemoveContainer" containerID="05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91" Jul 22 17:01:05.147599 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.147584 2574 scope.go:117] "RemoveContainer" containerID="9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432" Jul 22 17:01:05.147866 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:01:05.147829 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432\": container with ID starting with 9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432 not found: ID does not exist" containerID="9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432" Jul 22 17:01:05.147910 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.147873 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432"} err="failed to get container status \"9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432\": rpc error: code = NotFound desc = could not find container \"9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432\": container with ID starting with 9b94994b9baac40fa74da96e57f263899e5be9e2223d3a28f6110cfd24412432 not found: ID does not exist" Jul 22 17:01:05.147910 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.147890 2574 scope.go:117] "RemoveContainer" containerID="05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91" Jul 22 17:01:05.148120 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:01:05.148103 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91\": container with ID starting with 05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91 not found: ID does not exist" containerID="05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91" Jul 22 17:01:05.148157 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.148126 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91"} err="failed to get container status \"05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91\": rpc error: code = NotFound desc = could not find container \"05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91\": container with ID starting with 05d7967504a94a8344e9283b415c12aecedc5622b966953a2f18ffabbb95ba91 not found: ID does not exist" Jul 22 17:01:05.154246 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.154225 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r"] Jul 22 17:01:05.158677 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:05.158650 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-314e2c-openshift-default-988b5fc7c-tpj6r"] Jul 22 17:01:06.102986 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:06.102954 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" path="/var/lib/kubelet/pods/1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f/volumes" Jul 22 17:01:10.560774 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:10.560737 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:15.153707 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:15.153681 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:15.606196 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:15.606154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:21.973819 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:21.973788 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:22.074165 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:22.074134 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:22.239278 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:22.239197 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb"] Jul 22 17:01:22.239508 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:22.239484 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" containerID="cri-o://41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715" gracePeriod=30 Jul 22 17:01:22.260424 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:22.260387 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:22.506225 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:22.506146 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:22.887781 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:22.887704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:23.178808 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.178730 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4"] Jul 22 17:01:23.179205 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.179064 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6f9db5-eeb2-4427-b123-1e53ea5b300e" containerName="revoke-keys" Jul 22 17:01:23.179205 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.179076 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6f9db5-eeb2-4427-b123-1e53ea5b300e" containerName="revoke-keys" Jul 22 17:01:23.179205 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.179088 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" Jul 22 17:01:23.179205 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.179093 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" Jul 22 17:01:23.179205 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.179141 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6f9db5-eeb2-4427-b123-1e53ea5b300e" containerName="revoke-keys" Jul 22 17:01:23.179205 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.179148 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" Jul 22 17:01:23.181806 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.181790 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.184247 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.184223 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-bf7663-openshift-default-dockercfg-lqkhq\"" Jul 22 17:01:23.192173 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.192147 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4"] Jul 22 17:01:23.205314 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.205290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:23.303016 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.302978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-credential-socket\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303016 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmb74\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-kube-api-access-kmb74\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303248 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-envoy\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303248 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-podinfo\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303248 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae790c7-0e0c-48b3-831a-dd45739d885d-istiod-ca-cert\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303248 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-certs\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303248 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303197 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-socket\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303478 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-data\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.303478 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.303325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-token\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404250 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-podinfo\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404250 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae790c7-0e0c-48b3-831a-dd45739d885d-istiod-ca-cert\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-certs\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-socket\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-data\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-token\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404734 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-credential-socket\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404734 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmb74\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-kube-api-access-kmb74\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404734 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404692 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-envoy\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404734 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404690 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-certs\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.404964 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.404770 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-data\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.405069 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.405042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-credential-socket\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.405202 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.405180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-socket\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.405490 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.405466 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae790c7-0e0c-48b3-831a-dd45739d885d-istiod-ca-cert\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.407046 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.407026 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-envoy\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.407173 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.407156 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-podinfo\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.408793 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.408763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:23.412866 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.412823 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-token\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.413064 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.413045 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmb74\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-kube-api-access-kmb74\") pod \"e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.491900 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.491871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:23.624671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.624646 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4"] Jul 22 17:01:23.626975 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:01:23.626946 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae790c7_0e0c_48b3_831a_dd45739d885d.slice/crio-8add84664e9203830c956f6a8093438ffc5e8e579f04bf822315ae6243a1013a WatchSource:0}: Error finding container 8add84664e9203830c956f6a8093438ffc5e8e579f04bf822315ae6243a1013a: Status 404 returned error can't find the container with id 8add84664e9203830c956f6a8093438ffc5e8e579f04bf822315ae6243a1013a Jul 22 17:01:23.629385 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.629351 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:23.629493 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.629437 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:23.629558 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:23.629486 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:24.220501 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:24.220460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" event={"ID":"aae790c7-0e0c-48b3-831a-dd45739d885d","Type":"ContainerStarted","Data":"a7744b9e21090faf1a65ea2b908aa0d9ae24513cf26a4ce78aed28295fc236e0"} Jul 22 17:01:24.220915 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:24.220519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" event={"ID":"aae790c7-0e0c-48b3-831a-dd45739d885d","Type":"ContainerStarted","Data":"8add84664e9203830c956f6a8093438ffc5e8e579f04bf822315ae6243a1013a"} Jul 22 17:01:24.242638 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:24.242582 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podStartSLOduration=1.242566131 podStartE2EDuration="1.242566131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:01:24.241329797 +0000 UTC m=+2420.994265947" watchObservedRunningTime="2026-07-22 17:01:24.242566131 +0000 UTC m=+2420.995502280" Jul 22 17:01:24.492600 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:24.492517 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:24.497280 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:24.497256 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:25.225053 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:25.225022 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:25.226009 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:25.225989 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:26.226409 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:26.226374 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:26.315818 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:26.315780 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:26.389005 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:26.388974 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:26.489296 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:26.489211 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:26.947857 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:26.947803 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:27.045032 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.045004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:27.486434 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.486409 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 17:01:27.647090 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647009 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-credential-socket\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647090 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647059 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-istio-token\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647090 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647076 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279a465f-af3d-4d99-8683-1b48377b819f-istiod-ca-cert\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647308 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647113 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-certs\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647308 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647147 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-data\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647308 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647207 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-envoy\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647308 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647249 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-socket\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647308 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647302 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279a465f-af3d-4d99-8683-1b48377b819f-istio-podinfo\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647570 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647355 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7st8f\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-kube-api-access-7st8f\") pod \"279a465f-af3d-4d99-8683-1b48377b819f\" (UID: \"279a465f-af3d-4d99-8683-1b48377b819f\") " Jul 22 17:01:27.647570 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647502 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:27.647570 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647547 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279a465f-af3d-4d99-8683-1b48377b819f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:01:27.647570 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647556 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:27.647790 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647616 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:27.647790 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647636 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279a465f-af3d-4d99-8683-1b48377b819f-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.647790 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647654 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.647790 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.647668 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.648190 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.648163 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-data" (OuterVolumeSpecName: "istio-data") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:27.649513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.649485 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-istio-token" (OuterVolumeSpecName: "istio-token") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:01:27.649609 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.649514 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:01:27.649609 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.649551 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/279a465f-af3d-4d99-8683-1b48377b819f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 17:01:27.649609 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.649576 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-kube-api-access-7st8f" (OuterVolumeSpecName: "kube-api-access-7st8f") pod "279a465f-af3d-4d99-8683-1b48377b819f" (UID: "279a465f-af3d-4d99-8683-1b48377b819f"). InnerVolumeSpecName "kube-api-access-7st8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:01:27.754773 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.754735 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.754981 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.754763 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.754981 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.754906 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279a465f-af3d-4d99-8683-1b48377b819f-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.754981 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.754915 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7st8f\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-kube-api-access-7st8f\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.754981 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.754926 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279a465f-af3d-4d99-8683-1b48377b819f-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:27.754981 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:27.754934 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279a465f-af3d-4d99-8683-1b48377b819f-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:01:28.240448 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.240414 2574 generic.go:356] "Generic (PLEG): container finished" podID="279a465f-af3d-4d99-8683-1b48377b819f" containerID="41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715" exitCode=0 Jul 22 17:01:28.240617 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.240483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" event={"ID":"279a465f-af3d-4d99-8683-1b48377b819f","Type":"ContainerDied","Data":"41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715"} Jul 22 17:01:28.240617 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.240531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" event={"ID":"279a465f-af3d-4d99-8683-1b48377b819f","Type":"ContainerDied","Data":"be0f3432b7220fd1e48ea046e2589548546d8850619e2256abb8c29f5d9f8412"} Jul 22 17:01:28.240617 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.240552 2574 scope.go:117] "RemoveContainer" containerID="41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715" Jul 22 17:01:28.240617 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.240482 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb" Jul 22 17:01:28.248997 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.248976 2574 scope.go:117] "RemoveContainer" containerID="069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4" Jul 22 17:01:28.261209 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.261165 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb"] Jul 22 17:01:28.261920 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.261418 2574 scope.go:117] "RemoveContainer" containerID="41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715" Jul 22 17:01:28.262364 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:01:28.262313 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715\": container with ID starting with 41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715 not found: ID does not exist" containerID="41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715" Jul 22 17:01:28.262491 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.262356 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715"} err="failed to get container status \"41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715\": rpc error: code = NotFound desc = could not find container \"41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715\": container with ID starting with 41f056684d612453c82b1b1577829c1d4b1e1bd7192f704285a0390a222eb715 not found: ID does not exist" Jul 22 17:01:28.262491 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.262382 2574 scope.go:117] "RemoveContainer" containerID="069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4" Jul 22 17:01:28.262895 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:01:28.262754 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4\": container with ID starting with 069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4 not found: ID does not exist" containerID="069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4" Jul 22 17:01:28.262895 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.262864 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4"} err="failed to get container status \"069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4\": rpc error: code = NotFound desc = could not find container \"069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4\": container with ID starting with 069273ba80fd64fa934ce1ffe71ffde0bde22b7b68efe378786840a9ea4d27e4 not found: ID does not exist" Jul 22 17:01:28.265469 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:28.265446 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4b1cd3-openshift-default-55c9fbddf7-rlbgb"] Jul 22 17:01:30.103629 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:30.103595 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279a465f-af3d-4d99-8683-1b48377b819f" path="/var/lib/kubelet/pods/279a465f-af3d-4d99-8683-1b48377b819f/volumes" Jul 22 17:01:30.770970 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:30.770944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:31.285104 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.285076 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:31.575466 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575379 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc"] Jul 22 17:01:31.575886 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575865 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" Jul 22 17:01:31.575989 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575889 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" Jul 22 17:01:31.575989 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575913 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" Jul 22 17:01:31.575989 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575922 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" Jul 22 17:01:31.575989 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575934 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" Jul 22 17:01:31.575989 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.575943 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" Jul 22 17:01:31.576200 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.576032 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" Jul 22 17:01:31.576200 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.576042 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="279a465f-af3d-4d99-8683-1b48377b819f" containerName="istio-proxy" Jul 22 17:01:31.576200 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.576055 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3c0b6c-ac59-4a33-ae1f-888f82ffc82f" containerName="istio-proxy" Jul 22 17:01:31.579596 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.579575 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.582101 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.582079 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0f66aa-openshift-default-dockercfg-5t6tq\"" Jul 22 17:01:31.589458 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.588807 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc"] Jul 22 17:01:31.616040 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.616012 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:31.690052 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-credential-socket\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690244 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgptf\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-kube-api-access-fgptf\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690244 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-data\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690244 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-socket\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690244 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-token\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690473 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-certs\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690473 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-envoy\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690473 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istiod-ca-cert\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.690473 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.690389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-podinfo\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.733466 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.733432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:31.791344 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-certs\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791344 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-envoy\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791592 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istiod-ca-cert\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791592 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-podinfo\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791592 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-credential-socket\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791592 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgptf\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-kube-api-access-fgptf\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791592 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-data\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791867 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-socket\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.791867 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.791622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-token\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.793013 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.792973 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-credential-socket\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.793013 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.792994 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-certs\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.793536 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.793042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-socket\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.793536 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.793081 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-data\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.793926 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.793902 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istiod-ca-cert\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.795765 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.795739 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-envoy\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.796101 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.796048 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-podinfo\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.803182 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.803152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgptf\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-kube-api-access-fgptf\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.803265 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.803240 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-token\") pod \"e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:31.893141 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:31.893068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:32.046415 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.046391 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc"] Jul 22 17:01:32.048273 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:01:32.048251 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37730c9d_7d6c_4689_9f75_5f334dde4c6e.slice/crio-ac52793c8ae61351116b2f4a03b1360e6b2d74553160b9695dfe895cf85ba446 WatchSource:0}: Error finding container ac52793c8ae61351116b2f4a03b1360e6b2d74553160b9695dfe895cf85ba446: Status 404 returned error can't find the container with id ac52793c8ae61351116b2f4a03b1360e6b2d74553160b9695dfe895cf85ba446 Jul 22 17:01:32.050757 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.050715 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:32.050887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.050779 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:32.050887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.050809 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:32.269692 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.269652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" event={"ID":"37730c9d-7d6c-4689-9f75-5f334dde4c6e","Type":"ContainerStarted","Data":"0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af"} Jul 22 17:01:32.269891 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.269732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" event={"ID":"37730c9d-7d6c-4689-9f75-5f334dde4c6e","Type":"ContainerStarted","Data":"ac52793c8ae61351116b2f4a03b1360e6b2d74553160b9695dfe895cf85ba446"} Jul 22 17:01:32.291524 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.291474 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podStartSLOduration=1.291459473 podStartE2EDuration="1.291459473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:01:32.289403942 +0000 UTC m=+2429.042340128" watchObservedRunningTime="2026-07-22 17:01:32.291459473 +0000 UTC m=+2429.044395680" Jul 22 17:01:32.893851 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:32.893799 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:33.898532 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:33.898503 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:34.256368 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:34.256332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:34.280032 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:34.279988 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:34.280917 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:34.280896 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:34.362200 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:34.362170 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:34.548342 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:34.548261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:34.645156 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:34.645122 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:35.287043 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:35.287009 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:35.392723 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:35.392688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:38.836175 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:38.836127 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:41.267021 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:41.266977 2574 patch_prober.go:28] interesting pod/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 17:01:41.267422 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:41.267040 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 17:01:42.317761 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:42.317723 2574 generic.go:356] "Generic (PLEG): container finished" podID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerID="a7744b9e21090faf1a65ea2b908aa0d9ae24513cf26a4ce78aed28295fc236e0" exitCode=0 Jul 22 17:01:42.318229 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:42.317799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" event={"ID":"aae790c7-0e0c-48b3-831a-dd45739d885d","Type":"ContainerDied","Data":"a7744b9e21090faf1a65ea2b908aa0d9ae24513cf26a4ce78aed28295fc236e0"} Jul 22 17:01:42.318276 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:42.318228 2574 scope.go:117] "RemoveContainer" containerID="a7744b9e21090faf1a65ea2b908aa0d9ae24513cf26a4ce78aed28295fc236e0" Jul 22 17:01:42.319329 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:42.319298 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:42.319401 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:42.319372 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:42.319442 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:42.319420 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:43.324667 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:43.324620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" event={"ID":"aae790c7-0e0c-48b3-831a-dd45739d885d","Type":"ContainerStarted","Data":"79758eb0f9be43776f54c7fde5eb8866bcab6dedc09cb4b140623a16f73766ec"} Jul 22 17:01:43.492778 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:43.492741 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:43.493102 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:43.493079 2574 patch_prober.go:28] interesting pod/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 22 17:01:43.493163 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:43.493129 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 22 17:01:44.492984 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:44.492942 2574 patch_prober.go:28] interesting pod/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 22 17:01:44.493392 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:44.493006 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 22 17:01:45.493264 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:45.493221 2574 patch_prober.go:28] interesting pod/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 22 17:01:45.493644 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:45.493283 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 22 17:01:46.492530 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:46.492489 2574 patch_prober.go:28] interesting pod/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 22 17:01:46.492726 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:46.492546 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 22 17:01:47.496100 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:47.496056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:47.496540 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:47.496343 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:47.496972 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:47.496953 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:01:47.981377 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:47.981345 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:48.081921 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:48.081888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:48.841828 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:48.841794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:50.322011 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:50.321967 2574 patch_prober.go:28] interesting pod/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 17:01:50.322402 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:50.322073 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 17:01:51.374315 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:51.374278 2574 generic.go:356] "Generic (PLEG): container finished" podID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerID="0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af" exitCode=0 Jul 22 17:01:51.374890 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:51.374356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" event={"ID":"37730c9d-7d6c-4689-9f75-5f334dde4c6e","Type":"ContainerDied","Data":"0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af"} Jul 22 17:01:51.374890 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:51.374866 2574 scope.go:117] "RemoveContainer" containerID="0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af" Jul 22 17:01:51.375908 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:51.375881 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:51.375980 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:51.375948 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:51.376025 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:51.375990 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:01:52.380937 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:52.380899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" event={"ID":"37730c9d-7d6c-4689-9f75-5f334dde4c6e","Type":"ContainerStarted","Data":"3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb"} Jul 22 17:01:52.893430 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:52.893394 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:52.893703 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:52.893681 2574 patch_prober.go:28] interesting pod/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 22 17:01:52.893754 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:52.893731 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 22 17:01:53.894315 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:53.894278 2574 patch_prober.go:28] interesting pod/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 22 17:01:53.894725 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:53.894335 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 22 17:01:54.894052 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:54.894013 2574 patch_prober.go:28] interesting pod/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 22 17:01:54.894244 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:54.894073 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 22 17:01:55.893626 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:55.893585 2574 patch_prober.go:28] interesting pod/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 22 17:01:55.894144 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:55.893644 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 22 17:01:56.050688 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:56.050652 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:56.148232 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:56.148127 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:56.897636 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:56.897606 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:56.898057 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:56.897867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:56.898579 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:56.898560 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:01:57.764962 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:57.764929 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:01:57.864887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:01:57.864818 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:03.448959 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:03.448928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:06.474846 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:06.474814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:06.575253 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:06.575191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:07.282185 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:07.282150 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:07.681103 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:07.681073 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:14.043512 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:14.043475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:14.100792 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:14.100763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:14.313512 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:14.313417 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4"] Jul 22 17:02:14.313692 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:14.313655 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" containerID="cri-o://79758eb0f9be43776f54c7fde5eb8866bcab6dedc09cb4b140623a16f73766ec" gracePeriod=30 Jul 22 17:02:14.334979 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:14.334948 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:14.569777 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:14.569695 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:15.351827 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:15.351794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:15.449447 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:15.449415 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:17.498861 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:17.498810 2574 patch_prober.go:28] interesting pod/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 22 17:02:17.499325 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:17.498927 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 17:02:19.505980 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.505940 2574 generic.go:356] "Generic (PLEG): container finished" podID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerID="79758eb0f9be43776f54c7fde5eb8866bcab6dedc09cb4b140623a16f73766ec" exitCode=0 Jul 22 17:02:19.506348 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.506010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" event={"ID":"aae790c7-0e0c-48b3-831a-dd45739d885d","Type":"ContainerDied","Data":"79758eb0f9be43776f54c7fde5eb8866bcab6dedc09cb4b140623a16f73766ec"} Jul 22 17:02:19.506348 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.506105 2574 scope.go:117] "RemoveContainer" containerID="a7744b9e21090faf1a65ea2b908aa0d9ae24513cf26a4ce78aed28295fc236e0" Jul 22 17:02:19.570772 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.570746 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:02:19.702133 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702097 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmb74\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-kube-api-access-kmb74\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702140 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-data\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702181 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-envoy\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702216 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-token\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702256 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae790c7-0e0c-48b3-831a-dd45739d885d-istiod-ca-cert\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702275 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-socket\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702309 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-credential-socket\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702640 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702592 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:19.702702 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702626 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:19.702753 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702701 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae790c7-0e0c-48b3-831a-dd45739d885d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:02:19.702753 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702703 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-podinfo\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.702873 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.702778 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-certs\") pod \"aae790c7-0e0c-48b3-831a-dd45739d885d\" (UID: \"aae790c7-0e0c-48b3-831a-dd45739d885d\") " Jul 22 17:02:19.703162 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.703098 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae790c7-0e0c-48b3-831a-dd45739d885d-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.703162 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.703123 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.703162 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.703137 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.703529 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.703227 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-data" (OuterVolumeSpecName: "istio-data") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:19.703529 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.703295 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:19.704534 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.704504 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:19.704534 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.704508 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-kube-api-access-kmb74" (OuterVolumeSpecName: "kube-api-access-kmb74") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "kube-api-access-kmb74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:02:19.704678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.704619 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-token" (OuterVolumeSpecName: "istio-token") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:02:19.704678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.704642 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aae790c7-0e0c-48b3-831a-dd45739d885d" (UID: "aae790c7-0e0c-48b3-831a-dd45739d885d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 17:02:19.804580 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.804547 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.804580 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.804573 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmb74\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-kube-api-access-kmb74\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.804580 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.804585 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.804812 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.804593 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.804812 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.804601 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:19.804812 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:19.804609 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae790c7-0e0c-48b3-831a-dd45739d885d-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:20.511506 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:20.511474 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" Jul 22 17:02:20.512008 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:20.511513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4" event={"ID":"aae790c7-0e0c-48b3-831a-dd45739d885d","Type":"ContainerDied","Data":"8add84664e9203830c956f6a8093438ffc5e8e579f04bf822315ae6243a1013a"} Jul 22 17:02:20.512008 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:20.511585 2574 scope.go:117] "RemoveContainer" containerID="79758eb0f9be43776f54c7fde5eb8866bcab6dedc09cb4b140623a16f73766ec" Jul 22 17:02:20.531633 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:20.531607 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4"] Jul 22 17:02:20.535386 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:20.535360 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-bf7663-openshift-default-c9fb965f9-8qqt4"] Jul 22 17:02:22.103611 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:22.103573 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" path="/var/lib/kubelet/pods/aae790c7-0e0c-48b3-831a-dd45739d885d/volumes" Jul 22 17:02:30.200285 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:30.200255 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:34.778875 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:34.778822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:35.219874 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:35.219830 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:41.399859 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.399813 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:41.501414 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.501384 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:41.696849 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.696800 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc"] Jul 22 17:02:41.697106 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.697057 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" containerID="cri-o://3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb" gracePeriod=30 Jul 22 17:02:41.723614 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.723591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:41.900148 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.900116 2574 patch_prober.go:28] interesting pod/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 17:02:41.900304 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.900185 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 17:02:41.989353 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:41.989274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:42.361804 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.361710 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:42.657159 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.657076 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5"] Jul 22 17:02:42.657608 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.657525 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" Jul 22 17:02:42.657608 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.657543 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" Jul 22 17:02:42.657608 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.657564 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" Jul 22 17:02:42.657608 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.657573 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" Jul 22 17:02:42.657827 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.657648 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" Jul 22 17:02:42.660868 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.660827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.663461 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.663442 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d6d924-openshift-default-dockercfg-8z572\"" Jul 22 17:02:42.672186 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.672168 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5"] Jul 22 17:02:42.685225 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.685201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:42.700652 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istiod-ca-cert\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700762 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-podinfo\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700762 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbcd\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-kube-api-access-5zbcd\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700870 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-envoy\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700870 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-data\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700870 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-socket\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700991 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-token\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700991 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-certs\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.700991 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.700959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-credential-socket\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802085 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-podinfo\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802277 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbcd\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-kube-api-access-5zbcd\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802277 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-envoy\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802277 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-data\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802277 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-socket\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802487 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-token\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802487 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-certs\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802593 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-credential-socket\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802593 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istiod-ca-cert\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802593 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-socket\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802876 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802803 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-certs\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802876 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802825 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-data\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.802876 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.802859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-credential-socket\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.803266 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.803240 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istiod-ca-cert\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.804593 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.804568 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-envoy\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.804723 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.804703 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-podinfo\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.811048 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.811026 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-token\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.811214 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.811196 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbcd\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-kube-api-access-5zbcd\") pod \"e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:42.871636 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.871591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:42.971598 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:42.971559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:43.106584 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.106562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5"] Jul 22 17:02:43.108208 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:02:43.108182 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddaf0b7_4349_49e4_ba97_432f3175bfc6.slice/crio-cafa941ad8c9911931aed1155042d24fa1595e9ceeeb8e1ae05cd929fad2acc4 WatchSource:0}: Error finding container cafa941ad8c9911931aed1155042d24fa1595e9ceeeb8e1ae05cd929fad2acc4: Status 404 returned error can't find the container with id cafa941ad8c9911931aed1155042d24fa1595e9ceeeb8e1ae05cd929fad2acc4 Jul 22 17:02:43.110063 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.110030 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:02:43.110158 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.110097 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:02:43.110158 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.110125 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:02:43.615044 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.615012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" event={"ID":"2ddaf0b7-4349-49e4-ba97-432f3175bfc6","Type":"ContainerStarted","Data":"3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904"} Jul 22 17:02:43.615228 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.615094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" event={"ID":"2ddaf0b7-4349-49e4-ba97-432f3175bfc6","Type":"ContainerStarted","Data":"cafa941ad8c9911931aed1155042d24fa1595e9ceeeb8e1ae05cd929fad2acc4"} Jul 22 17:02:43.637820 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.637761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podStartSLOduration=1.637747376 podStartE2EDuration="1.637747376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:02:43.636408697 +0000 UTC m=+2500.389344863" watchObservedRunningTime="2026-07-22 17:02:43.637747376 +0000 UTC m=+2500.390683526" Jul 22 17:02:43.972259 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:43.972235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:44.977602 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:44.977572 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:45.604869 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:45.604815 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:45.626601 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:45.626536 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:45.627973 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:45.627947 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:02:45.702375 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:45.702329 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:45.802901 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:45.802863 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:45.905699 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:45.905607 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:46.403456 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:46.403425 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:46.505160 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:46.505118 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:46.954025 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:46.953996 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:02:47.043513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043428 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-credential-socket\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043466 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-certs\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043497 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-envoy\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043514 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgptf\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-kube-api-access-fgptf\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043531 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-data\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043551 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-podinfo\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043584 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-socket\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043600 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-token\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043642 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istiod-ca-cert\") pod \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\" (UID: \"37730c9d-7d6c-4689-9f75-5f334dde4c6e\") " Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043783 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:47.043887 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043787 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:47.044291 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043975 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.044291 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.043993 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.044291 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.044143 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:02:47.044291 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.044167 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:47.044680 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.044652 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:47.045869 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.045824 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 17:02:47.045869 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.045824 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:02:47.046032 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.045949 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:02:47.046032 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.045966 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-kube-api-access-fgptf" (OuterVolumeSpecName: "kube-api-access-fgptf") pod "37730c9d-7d6c-4689-9f75-5f334dde4c6e" (UID: "37730c9d-7d6c-4689-9f75-5f334dde4c6e"). InnerVolumeSpecName "kube-api-access-fgptf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:02:47.144931 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144894 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.144931 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144928 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.145137 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144941 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.145137 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144955 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.145137 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144968 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgptf\" (UniqueName: \"kubernetes.io/projected/37730c9d-7d6c-4689-9f75-5f334dde4c6e-kube-api-access-fgptf\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.145137 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144981 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.145137 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.144994 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37730c9d-7d6c-4689-9f75-5f334dde4c6e-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:02:47.637447 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.637408 2574 generic.go:356] "Generic (PLEG): container finished" podID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerID="3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb" exitCode=0 Jul 22 17:02:47.637987 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.637455 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" Jul 22 17:02:47.637987 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.637491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" event={"ID":"37730c9d-7d6c-4689-9f75-5f334dde4c6e","Type":"ContainerDied","Data":"3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb"} Jul 22 17:02:47.637987 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.637543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc" event={"ID":"37730c9d-7d6c-4689-9f75-5f334dde4c6e","Type":"ContainerDied","Data":"ac52793c8ae61351116b2f4a03b1360e6b2d74553160b9695dfe895cf85ba446"} Jul 22 17:02:47.637987 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.637570 2574 scope.go:117] "RemoveContainer" containerID="3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb" Jul 22 17:02:47.648187 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.648174 2574 scope.go:117] "RemoveContainer" containerID="0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af" Jul 22 17:02:47.655986 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.655953 2574 scope.go:117] "RemoveContainer" containerID="3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb" Jul 22 17:02:47.656237 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:02:47.656217 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb\": container with ID starting with 3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb not found: ID does not exist" containerID="3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb" Jul 22 17:02:47.656325 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.656248 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb"} err="failed to get container status \"3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb\": rpc error: code = NotFound desc = could not find container \"3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb\": container with ID starting with 3110b8e5998c49e792535bb5c60cb5e40db01b368f06090bca552067c0e0a0cb not found: ID does not exist" Jul 22 17:02:47.656325 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.656270 2574 scope.go:117] "RemoveContainer" containerID="0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af" Jul 22 17:02:47.656519 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:02:47.656501 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af\": container with ID starting with 0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af not found: ID does not exist" containerID="0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af" Jul 22 17:02:47.656578 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.656528 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af"} err="failed to get container status \"0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af\": rpc error: code = NotFound desc = could not find container \"0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af\": container with ID starting with 0274a7a34f401769d6725aff1c4bb23cc44f0f08a09215109efd884e7fb678af not found: ID does not exist" Jul 22 17:02:47.669445 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.666364 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc"] Jul 22 17:02:47.672659 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:47.672633 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0f66aa-openshift-default-987fb6b97-x4hvc"] Jul 22 17:02:48.103473 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:48.103436 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" path="/var/lib/kubelet/pods/37730c9d-7d6c-4689-9f75-5f334dde4c6e/volumes" Jul 22 17:02:50.170437 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.170404 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:50.539039 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.539012 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:50.871539 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.871450 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85"] Jul 22 17:02:50.872197 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.872171 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" Jul 22 17:02:50.872197 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.872195 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" Jul 22 17:02:50.872432 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.872289 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae790c7-0e0c-48b3-831a-dd45739d885d" containerName="istio-proxy" Jul 22 17:02:50.872432 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.872302 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" Jul 22 17:02:50.872432 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.872312 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" Jul 22 17:02:50.876920 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.876897 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.879586 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.879567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cfb31b-openshift-default-dockercfg-g6kw8\"" Jul 22 17:02:50.887290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.887269 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85"] Jul 22 17:02:50.891893 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.891868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:50.974960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.974930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-istio-token\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975141 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.974967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-socket\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975141 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975003 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc1fe45-93d0-4230-9551-96c099055682-istiod-ca-cert\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975141 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-data\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975141 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc1fe45-93d0-4230-9551-96c099055682-istio-podinfo\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975288 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-credential-socket\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975288 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-certs\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975288 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-envoy\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.975288 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.975266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrdjm\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-kube-api-access-rrdjm\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:50.985690 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:50.985664 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:51.076459 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-credential-socket\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076636 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-certs\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076636 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-envoy\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076636 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrdjm\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-kube-api-access-rrdjm\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076788 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-istio-token\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076788 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-socket\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076788 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc1fe45-93d0-4230-9551-96c099055682-istiod-ca-cert\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-credential-socket\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-data\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-certs\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.076960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.076911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc1fe45-93d0-4230-9551-96c099055682-istio-podinfo\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.077128 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.077055 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-socket\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.077168 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.077138 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-data\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.077482 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.077453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc1fe45-93d0-4230-9551-96c099055682-istiod-ca-cert\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.079252 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.079232 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-envoy\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.079392 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.079374 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc1fe45-93d0-4230-9551-96c099055682-istio-podinfo\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.085551 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.085529 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-istio-token\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.085731 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.085711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrdjm\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-kube-api-access-rrdjm\") pod \"e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.188770 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.188727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:51.321094 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.321068 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85"] Jul 22 17:02:51.322784 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:02:51.322754 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc1fe45_93d0_4230_9551_96c099055682.slice/crio-00dba6a412fc60c9c1e97864b128c26317e48d4d9a937d011d16cfae493e71b8 WatchSource:0}: Error finding container 00dba6a412fc60c9c1e97864b128c26317e48d4d9a937d011d16cfae493e71b8: Status 404 returned error can't find the container with id 00dba6a412fc60c9c1e97864b128c26317e48d4d9a937d011d16cfae493e71b8 Jul 22 17:02:51.324817 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.324780 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:02:51.324921 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.324868 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:02:51.324921 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.324897 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:02:51.658574 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.658470 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" event={"ID":"9fc1fe45-93d0-4230-9551-96c099055682","Type":"ContainerStarted","Data":"519c1b6deb084824fccedf9fbc0bb40c03c53d51704a9c32d5a927ed7fca0c84"} Jul 22 17:02:51.658574 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.658540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" event={"ID":"9fc1fe45-93d0-4230-9551-96c099055682","Type":"ContainerStarted","Data":"00dba6a412fc60c9c1e97864b128c26317e48d4d9a937d011d16cfae493e71b8"} Jul 22 17:02:51.680439 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:51.680390 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podStartSLOduration=1.680373989 podStartE2EDuration="1.680373989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:02:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:02:51.678403564 +0000 UTC m=+2508.431339710" watchObservedRunningTime="2026-07-22 17:02:51.680373989 +0000 UTC m=+2508.433310139" Jul 22 17:02:52.189812 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:52.189776 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:52.194688 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:52.194665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:52.663293 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:52.663212 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:52.664156 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:52.664136 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:02:53.773952 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:53.773919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:53.854804 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:53.854768 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:53.959687 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:53.959654 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:54.243725 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:54.243670 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:54.606066 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:54.605980 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:54.707256 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:54.707225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:02:58.241107 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:02:58.240905 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:01.198433 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.197517 2574 patch_prober.go:28] interesting pod/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:45378->10.134.0.44:15021: read: connection reset by peer" start-of-body= Jul 22 17:03:01.198433 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.197597 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:45378->10.134.0.44:15021: read: connection reset by peer" Jul 22 17:03:01.705039 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.705009 2574 generic.go:356] "Generic (PLEG): container finished" podID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerID="3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904" exitCode=0 Jul 22 17:03:01.705234 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.705085 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" event={"ID":"2ddaf0b7-4349-49e4-ba97-432f3175bfc6","Type":"ContainerDied","Data":"3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904"} Jul 22 17:03:01.705510 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.705494 2574 scope.go:117] "RemoveContainer" containerID="3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904" Jul 22 17:03:01.706487 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.706458 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:03:01.706575 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.706523 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:03:01.706575 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:01.706553 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:03:02.711316 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:02.711284 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" event={"ID":"2ddaf0b7-4349-49e4-ba97-432f3175bfc6","Type":"ContainerStarted","Data":"f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9"} Jul 22 17:03:02.972342 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:02.972244 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:03:02.972729 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:02.972633 2574 patch_prober.go:28] interesting pod/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 22 17:03:02.972950 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:02.972922 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 22 17:03:03.869617 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:03.869581 2574 scope.go:117] "RemoveContainer" containerID="e562fb6ba3b33c1b9dbe59f134a843193714a779d5c30782d2f924a0a9181fc7" Jul 22 17:03:03.972624 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:03.972585 2574 patch_prober.go:28] interesting pod/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 22 17:03:03.972956 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:03.972921 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 22 17:03:04.972560 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:04.972520 2574 patch_prober.go:28] interesting pod/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 22 17:03:04.972950 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:04.972583 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 22 17:03:05.972755 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:05.972713 2574 patch_prober.go:28] interesting pod/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 22 17:03:05.973180 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:05.972792 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 22 17:03:06.976428 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:06.976393 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:03:06.976902 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:06.976885 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:03:06.977609 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:06.977588 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:03:07.261333 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:07.261252 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:07.363016 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:07.362987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:07.432880 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:07.432826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:07.899388 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:07.898133 2574 patch_prober.go:28] interesting pod/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:41754->10.134.0.45:15021: read: connection reset by peer" start-of-body= Jul 22 17:03:07.899388 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:07.898204 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": read tcp 10.134.0.2:41754->10.134.0.45:15021: read: connection reset by peer" Jul 22 17:03:07.922525 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:03:07.922495 2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@12-23084-0.service\": RecentStats: unable to find data in memory cache]" Jul 22 17:03:08.740653 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:08.740616 2574 generic.go:356] "Generic (PLEG): container finished" podID="9fc1fe45-93d0-4230-9551-96c099055682" containerID="519c1b6deb084824fccedf9fbc0bb40c03c53d51704a9c32d5a927ed7fca0c84" exitCode=0 Jul 22 17:03:08.741335 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:08.740691 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" event={"ID":"9fc1fe45-93d0-4230-9551-96c099055682","Type":"ContainerDied","Data":"519c1b6deb084824fccedf9fbc0bb40c03c53d51704a9c32d5a927ed7fca0c84"} Jul 22 17:03:08.741335 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:08.741260 2574 scope.go:117] "RemoveContainer" containerID="519c1b6deb084824fccedf9fbc0bb40c03c53d51704a9c32d5a927ed7fca0c84" Jul 22 17:03:08.742290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:08.742262 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:03:08.742392 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:08.742345 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:03:08.742464 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:08.742391 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 17:03:09.752507 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:09.752468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" event={"ID":"9fc1fe45-93d0-4230-9551-96c099055682","Type":"ContainerStarted","Data":"886b3709091089fbe44668133aef54a18c48272eeddee2b878e71fd23ae9c388"} Jul 22 17:03:10.189457 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:10.189426 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:03:10.189699 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:10.189674 2574 patch_prober.go:28] interesting pod/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 22 17:03:10.189745 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:10.189727 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 22 17:03:11.189356 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:11.189318 2574 patch_prober.go:28] interesting pod/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 22 17:03:11.189763 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:11.189387 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 22 17:03:12.189560 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:12.189524 2574 patch_prober.go:28] interesting pod/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 22 17:03:12.190169 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:12.189608 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 22 17:03:12.913033 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:12.912994 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:13.189307 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:13.189270 2574 patch_prober.go:28] interesting pod/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 22 17:03:13.189490 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:13.189347 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 22 17:03:14.192981 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:14.192954 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:03:14.193447 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:14.193249 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:03:14.194061 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:14.194042 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:03:15.447685 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:15.447651 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:15.548203 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:15.548171 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:28.723778 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:28.723745 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:28.788481 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:28.788449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:03:45.828920 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:03:45.828888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:06:03.911461 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:06:03.911379 2574 scope.go:117] "RemoveContainer" containerID="79aa54b63726be07d68b8c6859106c7fd5189ce31ac43d3ae4cee972d21fd329" Jul 22 17:06:17.032965 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:06:17.032921 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:06:18.485096 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:06:18.485065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:06:30.716241 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:06:30.716203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:06:39.724462 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:06:39.724423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:07:00.286265 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:00.286226 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:07:03.929335 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:03.929305 2574 scope.go:117] "RemoveContainer" containerID="cc0ff41234369073088e79cfc43e09909e6debbc99245cafabda89c838731b57" Jul 22 17:07:06.449187 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:06.449153 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:07:06.548629 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:06.548598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:07:16.182118 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:16.182084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:07:52.845295 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:52.845261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:07:53.622206 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:07:53.622177 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:08:00.296660 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.296629 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh"] Jul 22 17:08:00.297051 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.296947 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" Jul 22 17:08:00.297051 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.296958 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="37730c9d-7d6c-4689-9f75-5f334dde4c6e" containerName="istio-proxy" Jul 22 17:08:00.299979 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.299961 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.302515 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.302496 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"openshift-service-ca.crt\"" Jul 22 17:08:00.303705 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.303683 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"default-dockercfg-tf27g\"" Jul 22 17:08:00.303821 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.303713 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"rate-test-model-d6d924-kserve-self-signed-certs\"" Jul 22 17:08:00.303821 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.303715 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d6d924\"/\"kube-root-ca.crt\"" Jul 22 17:08:00.311636 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.311613 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh"] Jul 22 17:08:00.319478 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.319457 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:08:00.349969 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.349939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-tmp-dir\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.350109 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.349986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-dshm\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.350109 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.350007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-home\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.350109 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.350069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338b6037-d927-4280-a1c1-04d319ea03f7-tls-certs\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.350109 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.350089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbf9n\" (UniqueName: \"kubernetes.io/projected/338b6037-d927-4280-a1c1-04d319ea03f7-kube-api-access-jbf9n\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.350275 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.350122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-model-cache\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450520 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-tmp-dir\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450679 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-dshm\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450679 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-home\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450679 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338b6037-d927-4280-a1c1-04d319ea03f7-tls-certs\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450679 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbf9n\" (UniqueName: \"kubernetes.io/projected/338b6037-d927-4280-a1c1-04d319ea03f7-kube-api-access-jbf9n\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450985 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-model-cache\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.450985 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.450934 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-tmp-dir\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.451105 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.451070 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-home\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.451105 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.451082 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-model-cache\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.452932 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.452911 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-dshm\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.453178 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.453161 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338b6037-d927-4280-a1c1-04d319ea03f7-tls-certs\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.459635 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.459615 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbf9n\" (UniqueName: \"kubernetes.io/projected/338b6037-d927-4280-a1c1-04d319ea03f7-kube-api-access-jbf9n\") pod \"rate-test-model-d6d924-kserve-979bfc4cf-m5lmh\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.608821 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.608737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:00.737613 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:00.737534 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh"] Jul 22 17:08:00.740360 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:08:00.740318 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod338b6037_d927_4280_a1c1_04d319ea03f7.slice/crio-e90ea499ee7a86008fcc82d2ce70ae00923e123c0997cef6496889e8e632a4b9 WatchSource:0}: Error finding container e90ea499ee7a86008fcc82d2ce70ae00923e123c0997cef6496889e8e632a4b9: Status 404 returned error can't find the container with id e90ea499ee7a86008fcc82d2ce70ae00923e123c0997cef6496889e8e632a4b9 Jul 22 17:08:01.025418 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:01.025380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" event={"ID":"338b6037-d927-4280-a1c1-04d319ea03f7","Type":"ContainerStarted","Data":"6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5"} Jul 22 17:08:01.025597 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:01.025428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" event={"ID":"338b6037-d927-4280-a1c1-04d319ea03f7","Type":"ContainerStarted","Data":"e90ea499ee7a86008fcc82d2ce70ae00923e123c0997cef6496889e8e632a4b9"} Jul 22 17:08:01.043871 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:01.043800 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" podStartSLOduration=1.043786696 podStartE2EDuration="1.043786696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:08:01.042210242 +0000 UTC m=+2817.795146395" watchObservedRunningTime="2026-07-22 17:08:01.043786696 +0000 UTC m=+2817.796722845" Jul 22 17:08:08.040861 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:08.040805 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:08:08.143373 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:08.143341 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:08:10.609902 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:10.609865 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:10.610301 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:10.609922 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:10.622340 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:10.622310 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:11.078435 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:11.078409 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:08:16.233872 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:16.233824 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:08:16.340140 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:16.340099 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:08:51.424861 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:08:51.424808 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:09:35.875814 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:35.875777 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh"] Jul 22 17:09:35.899404 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:35.899367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:09:36.815031 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:36.814993 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:09:50.895969 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:50.895927 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" podUID="338b6037-d927-4280-a1c1-04d319ea03f7" containerName="main" containerID="cri-o://6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5" gracePeriod=45 Jul 22 17:09:51.139860 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.139823 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:09:51.224307 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224276 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-tmp-dir\") pod \"338b6037-d927-4280-a1c1-04d319ea03f7\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " Jul 22 17:09:51.224495 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224327 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-model-cache\") pod \"338b6037-d927-4280-a1c1-04d319ea03f7\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " Jul 22 17:09:51.224495 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224357 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-dshm\") pod \"338b6037-d927-4280-a1c1-04d319ea03f7\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " Jul 22 17:09:51.224495 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224385 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338b6037-d927-4280-a1c1-04d319ea03f7-tls-certs\") pod \"338b6037-d927-4280-a1c1-04d319ea03f7\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " Jul 22 17:09:51.224495 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224422 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbf9n\" (UniqueName: \"kubernetes.io/projected/338b6037-d927-4280-a1c1-04d319ea03f7-kube-api-access-jbf9n\") pod \"338b6037-d927-4280-a1c1-04d319ea03f7\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " Jul 22 17:09:51.224495 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224459 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-home\") pod \"338b6037-d927-4280-a1c1-04d319ea03f7\" (UID: \"338b6037-d927-4280-a1c1-04d319ea03f7\") " Jul 22 17:09:51.224777 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224605 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "338b6037-d927-4280-a1c1-04d319ea03f7" (UID: "338b6037-d927-4280-a1c1-04d319ea03f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:09:51.224777 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224649 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "338b6037-d927-4280-a1c1-04d319ea03f7" (UID: "338b6037-d927-4280-a1c1-04d319ea03f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:09:51.224777 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224748 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-home" (OuterVolumeSpecName: "home") pod "338b6037-d927-4280-a1c1-04d319ea03f7" (UID: "338b6037-d927-4280-a1c1-04d319ea03f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:09:51.224965 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224784 2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-tmp-dir\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:09:51.224965 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.224803 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-model-cache\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:09:51.226695 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.226674 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/338b6037-d927-4280-a1c1-04d319ea03f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "338b6037-d927-4280-a1c1-04d319ea03f7" (UID: "338b6037-d927-4280-a1c1-04d319ea03f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:09:51.226769 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.226711 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-dshm" (OuterVolumeSpecName: "dshm") pod "338b6037-d927-4280-a1c1-04d319ea03f7" (UID: "338b6037-d927-4280-a1c1-04d319ea03f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:09:51.226809 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.226787 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338b6037-d927-4280-a1c1-04d319ea03f7-kube-api-access-jbf9n" (OuterVolumeSpecName: "kube-api-access-jbf9n") pod "338b6037-d927-4280-a1c1-04d319ea03f7" (UID: "338b6037-d927-4280-a1c1-04d319ea03f7"). InnerVolumeSpecName "kube-api-access-jbf9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:09:51.325562 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.325531 2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-dshm\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:09:51.325562 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.325557 2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338b6037-d927-4280-a1c1-04d319ea03f7-tls-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:09:51.325562 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.325568 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbf9n\" (UniqueName: \"kubernetes.io/projected/338b6037-d927-4280-a1c1-04d319ea03f7-kube-api-access-jbf9n\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:09:51.325787 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.325578 2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338b6037-d927-4280-a1c1-04d319ea03f7-home\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:09:51.509515 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.509422 2574 generic.go:356] "Generic (PLEG): container finished" podID="338b6037-d927-4280-a1c1-04d319ea03f7" containerID="6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5" exitCode=0 Jul 22 17:09:51.509515 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.509484 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" Jul 22 17:09:51.509515 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.509503 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" event={"ID":"338b6037-d927-4280-a1c1-04d319ea03f7","Type":"ContainerDied","Data":"6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5"} Jul 22 17:09:51.509739 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.509548 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" event={"ID":"338b6037-d927-4280-a1c1-04d319ea03f7","Type":"ContainerDied","Data":"e90ea499ee7a86008fcc82d2ce70ae00923e123c0997cef6496889e8e632a4b9"} Jul 22 17:09:51.509739 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.509566 2574 scope.go:117] "RemoveContainer" containerID="6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5" Jul 22 17:09:51.517914 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.517898 2574 scope.go:117] "RemoveContainer" containerID="6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5" Jul 22 17:09:51.518159 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:09:51.518144 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5\": container with ID starting with 6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5 not found: ID does not exist" containerID="6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5" Jul 22 17:09:51.518210 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.518165 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5"} err="failed to get container status \"6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5\": rpc error: code = NotFound desc = could not find container \"6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5\": container with ID starting with 6d64a4696eeb44768385e66f1115f439fb2cbeae6765b2c2fe87494164ea47a5 not found: ID does not exist" Jul 22 17:09:51.530828 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.530805 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh"] Jul 22 17:09:51.534440 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:51.534418 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh"] Jul 22 17:09:52.103931 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:52.103903 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="338b6037-d927-4280-a1c1-04d319ea03f7" path="/var/lib/kubelet/pods/338b6037-d927-4280-a1c1-04d319ea03f7/volumes" Jul 22 17:09:56.068851 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:56.068791 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-d6d924/rate-test-model-d6d924-kserve-979bfc4cf-m5lmh" podUID="338b6037-d927-4280-a1c1-04d319ea03f7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded" Jul 22 17:09:57.234104 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:57.234071 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:09:57.331124 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:09:57.331092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:07.141727 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:07.141693 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:11.760657 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:11.760621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:12.178883 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:12.178776 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:18.776592 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:18.776561 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:18.877722 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:18.877688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:19.046012 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:19.045916 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5"] Jul 22 17:10:19.046183 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:19.046141 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" containerID="cri-o://f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9" gracePeriod=30 Jul 22 17:10:19.070311 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:19.070271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:19.316769 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:19.316682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:19.984176 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:19.984140 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:20.091876 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:20.091829 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:21.979529 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:21.979489 2574 patch_prober.go:28] interesting pod/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 17:10:21.979971 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:21.979566 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 17:10:24.297399 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.297374 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:10:24.406644 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406552 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-data\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.406644 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406595 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-envoy\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.406644 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406623 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zbcd\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-kube-api-access-5zbcd\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.406644 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406642 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-socket\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.407022 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406657 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-certs\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.407022 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406674 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-token\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.407022 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406721 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istiod-ca-cert\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.407022 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406736 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-podinfo\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.407022 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.406753 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-credential-socket\") pod \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\" (UID: \"2ddaf0b7-4349-49e4-ba97-432f3175bfc6\") " Jul 22 17:10:24.407276 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.407033 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:24.407276 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.407220 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:10:24.407276 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.407224 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:24.407429 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.407410 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:24.407561 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.407522 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:24.409314 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.409291 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:24.409427 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.409314 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-kube-api-access-5zbcd" (OuterVolumeSpecName: "kube-api-access-5zbcd") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "kube-api-access-5zbcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:10:24.409490 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.409425 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:10:24.409490 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.409443 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ddaf0b7-4349-49e4-ba97-432f3175bfc6" (UID: "2ddaf0b7-4349-49e4-ba97-432f3175bfc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 17:10:24.507877 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507824 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.507877 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507874 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zbcd\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-kube-api-access-5zbcd\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.507877 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507885 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.508093 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507893 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.508093 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507903 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.508093 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507910 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.508093 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507917 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.508093 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507925 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.508093 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.507933 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ddaf0b7-4349-49e4-ba97-432f3175bfc6-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:24.653743 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.653708 2574 generic.go:356] "Generic (PLEG): container finished" podID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerID="f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9" exitCode=0 Jul 22 17:10:24.653937 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.653770 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" Jul 22 17:10:24.653937 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.653768 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" event={"ID":"2ddaf0b7-4349-49e4-ba97-432f3175bfc6","Type":"ContainerDied","Data":"f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9"} Jul 22 17:10:24.654072 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.653939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5" event={"ID":"2ddaf0b7-4349-49e4-ba97-432f3175bfc6","Type":"ContainerDied","Data":"cafa941ad8c9911931aed1155042d24fa1595e9ceeeb8e1ae05cd929fad2acc4"} Jul 22 17:10:24.654072 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.653982 2574 scope.go:117] "RemoveContainer" containerID="f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9" Jul 22 17:10:24.665098 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.664420 2574 scope.go:117] "RemoveContainer" containerID="3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904" Jul 22 17:10:24.673524 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.673506 2574 scope.go:117] "RemoveContainer" containerID="f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9" Jul 22 17:10:24.673809 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:10:24.673782 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9\": container with ID starting with f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9 not found: ID does not exist" containerID="f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9" Jul 22 17:10:24.673944 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.673816 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9"} err="failed to get container status \"f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9\": rpc error: code = NotFound desc = could not find container \"f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9\": container with ID starting with f3fe9f732c40aeb4f1af6784a06711f7765dc1b06bf9cab5119bae95ecd639e9 not found: ID does not exist" Jul 22 17:10:24.673944 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.673855 2574 scope.go:117] "RemoveContainer" containerID="3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904" Jul 22 17:10:24.674109 ip-10-0-143-30 kubenswrapper[2574]: E0722 17:10:24.674077 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904\": container with ID starting with 3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904 not found: ID does not exist" containerID="3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904" Jul 22 17:10:24.674166 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.674118 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904"} err="failed to get container status \"3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904\": rpc error: code = NotFound desc = could not find container \"3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904\": container with ID starting with 3f1297785f0a9d11104d10a0c3fa0304c56325db66e109579b853a104aa53904 not found: ID does not exist" Jul 22 17:10:24.679183 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.679162 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5"] Jul 22 17:10:24.683608 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:24.683587 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d6d924-openshift-default-5b986d959f-9cjs5"] Jul 22 17:10:26.103740 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:26.103660 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" path="/var/lib/kubelet/pods/2ddaf0b7-4349-49e4-ba97-432f3175bfc6/volumes" Jul 22 17:10:29.917455 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:29.917427 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:34.522427 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:34.522390 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:34.968719 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:34.968687 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:41.334391 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:41.334356 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:41.395228 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:41.395194 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:41.619229 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:41.619154 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85"] Jul 22 17:10:41.619445 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:41.619418 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" containerID="cri-o://886b3709091089fbe44668133aef54a18c48272eeddee2b878e71fd23ae9c388" gracePeriod=30 Jul 22 17:10:41.643524 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:41.643493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:41.898402 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:41.898311 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:10:44.195461 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:44.195424 2574 patch_prober.go:28] interesting pod/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 17:10:44.195888 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:44.195497 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 17:10:46.749796 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.749766 2574 generic.go:356] "Generic (PLEG): container finished" podID="9fc1fe45-93d0-4230-9551-96c099055682" containerID="886b3709091089fbe44668133aef54a18c48272eeddee2b878e71fd23ae9c388" exitCode=0 Jul 22 17:10:46.750172 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.749859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" event={"ID":"9fc1fe45-93d0-4230-9551-96c099055682","Type":"ContainerDied","Data":"886b3709091089fbe44668133aef54a18c48272eeddee2b878e71fd23ae9c388"} Jul 22 17:10:46.750172 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.749916 2574 scope.go:117] "RemoveContainer" containerID="519c1b6deb084824fccedf9fbc0bb40c03c53d51704a9c32d5a927ed7fca0c84" Jul 22 17:10:46.867513 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.867491 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:10:46.886500 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886447 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-certs\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886500 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886473 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-envoy\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886503 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-data\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886543 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc1fe45-93d0-4230-9551-96c099055682-istiod-ca-cert\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886581 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-credential-socket\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886635 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrdjm\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-kube-api-access-rrdjm\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886678 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886670 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-istio-token\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886702 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-socket\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886739 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc1fe45-93d0-4230-9551-96c099055682-istio-podinfo\") pod \"9fc1fe45-93d0-4230-9551-96c099055682\" (UID: \"9fc1fe45-93d0-4230-9551-96c099055682\") " Jul 22 17:10:46.886960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886742 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:46.886960 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.886886 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:46.887176 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887054 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:46.887176 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887060 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc1fe45-93d0-4230-9551-96c099055682-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:10:46.887366 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887324 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-certs\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.887366 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887347 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc1fe45-93d0-4230-9551-96c099055682-istiod-ca-cert\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.887366 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887360 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-credential-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.887529 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887375 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-workload-socket\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.887611 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.887593 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:46.889483 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.889458 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fc1fe45-93d0-4230-9551-96c099055682-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 17:10:46.889596 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.889526 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:10:46.890455 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.890414 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:10:46.890455 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.890431 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-kube-api-access-rrdjm" (OuterVolumeSpecName: "kube-api-access-rrdjm") pod "9fc1fe45-93d0-4230-9551-96c099055682" (UID: "9fc1fe45-93d0-4230-9551-96c099055682"). InnerVolumeSpecName "kube-api-access-rrdjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:10:46.988177 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.988153 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrdjm\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-kube-api-access-rrdjm\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.988177 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.988177 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc1fe45-93d0-4230-9551-96c099055682-istio-token\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.988342 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.988188 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc1fe45-93d0-4230-9551-96c099055682-istio-podinfo\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.988342 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.988195 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-envoy\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:46.988342 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:46.988203 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc1fe45-93d0-4230-9551-96c099055682-istio-data\") on node \"ip-10-0-143-30.ec2.internal\" DevicePath \"\"" Jul 22 17:10:47.755739 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:47.755709 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" Jul 22 17:10:47.755739 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:47.755721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85" event={"ID":"9fc1fe45-93d0-4230-9551-96c099055682","Type":"ContainerDied","Data":"00dba6a412fc60c9c1e97864b128c26317e48d4d9a937d011d16cfae493e71b8"} Jul 22 17:10:47.756253 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:47.755772 2574 scope.go:117] "RemoveContainer" containerID="886b3709091089fbe44668133aef54a18c48272eeddee2b878e71fd23ae9c388" Jul 22 17:10:47.778568 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:47.778546 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85"] Jul 22 17:10:47.783088 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:47.783065 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cfb31b-openshift-default-cd8449959-mgh85"] Jul 22 17:10:48.103774 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:48.103694 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc1fe45-93d0-4230-9551-96c099055682" path="/var/lib/kubelet/pods/9fc1fe45-93d0-4230-9551-96c099055682/volumes" Jul 22 17:10:48.602538 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:48.602509 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b7cff57-dchrb_c01efc96-1a3d-4900-b342-1cb7a59dbfb3/manager/0.log" Jul 22 17:10:49.262764 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:49.262701 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-s5lgh_ee016641-9aa0-4ebf-a5c2-8fee04ed8bec/copy-manifests/0.log" Jul 22 17:10:49.281504 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:49.281475 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-s5lgh_ee016641-9aa0-4ebf-a5c2-8fee04ed8bec/manager/0.log" Jul 22 17:10:49.775078 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:49.775049 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745645-kgbn9_aa6c7ba4-c909-4d1d-87fd-790ff4a8ee77/cleanup/0.log" Jul 22 17:10:49.888611 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:49.888573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745660-vfzv7_792f19ce-4f6a-4e51-8fba-90574f8cd1be/cleanup/0.log" Jul 22 17:10:52.908650 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:52.908618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789t6xg_be5b6faa-722c-45a4-8636-c6f37c42a352/istio-proxy/0.log" Jul 22 17:10:53.044585 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:53.044556 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rxh6w_8f33ace9-cbe1-4643-8d03-e3161e077bff/discovery/0.log" Jul 22 17:10:53.433548 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:53.433511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/1.log" Jul 22 17:10:53.757460 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:53.757388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4cqhk_bb045d52-53ac-4501-926c-36813ce1e58a/payload-processing/0.log" Jul 22 17:10:54.527516 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:10:54.527484 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8b7gn_b2166c70-c730-4ca8-91a0-624af1c51075/main/0.log" Jul 22 17:11:01.468309 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:01.468271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:11:01.564302 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:01.564271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" limit=1024 Jul 22 17:11:04.446629 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:04.446596 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5qd2x_96ac3a20-6e4d-4f3a-bed1-37320630118b/global-pull-secret-syncer/0.log" Jul 22 17:11:04.709747 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:04.709637 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dxzrj_5d3572e8-4046-49f3-bd59-eb7fa08defba/konnectivity-agent/0.log" Jul 22 17:11:05.108148 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:05.108056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-30.ec2.internal_68ef05445162f1383037c1357bbb8630/haproxy/0.log" Jul 22 17:11:13.213821 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:13.213788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cfb56b448-l4vrl_838ab7bf-6649-4185-a7ac-8a3dad9f2632/metrics-server/0.log" Jul 22 17:11:13.481151 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:13.481068 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-md4hb_da8b0933-3d77-4aa6-bc64-d49ccf649a3f/node-exporter/0.log" Jul 22 17:11:13.509389 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:13.509358 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-md4hb_da8b0933-3d77-4aa6-bc64-d49ccf649a3f/kube-rbac-proxy/0.log" Jul 22 17:11:13.530014 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:13.529987 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-md4hb_da8b0933-3d77-4aa6-bc64-d49ccf649a3f/init-textfile/0.log" Jul 22 17:11:14.208249 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208214 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj"] Jul 22 17:11:14.208523 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208493 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" Jul 22 17:11:14.208523 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208506 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" Jul 22 17:11:14.208523 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208520 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="338b6037-d927-4280-a1c1-04d319ea03f7" containerName="main" Jul 22 17:11:14.208523 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208526 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="338b6037-d927-4280-a1c1-04d319ea03f7" containerName="main" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208540 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208549 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208564 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208570 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208630 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208641 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208649 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc1fe45-93d0-4230-9551-96c099055682" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208654 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddaf0b7-4349-49e4-ba97-432f3175bfc6" containerName="istio-proxy" Jul 22 17:11:14.208671 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.208660 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="338b6037-d927-4280-a1c1-04d319ea03f7" containerName="main" Jul 22 17:11:14.211475 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.211459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.213999 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.213979 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg96g\"/\"kube-root-ca.crt\"" Jul 22 17:11:14.214355 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.214019 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg96g\"/\"openshift-service-ca.crt\"" Jul 22 17:11:14.214994 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.214981 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dg96g\"/\"default-dockercfg-jwkq6\"" Jul 22 17:11:14.221491 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.221472 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj"] Jul 22 17:11:14.313725 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.313694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-sys\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.313933 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.313734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-proc\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.313933 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.313762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-podres\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.313933 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.313888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9q8z\" (UniqueName: \"kubernetes.io/projected/e380aa03-48a9-4508-95e0-b4797f2d43b3-kube-api-access-r9q8z\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.313933 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.313921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-lib-modules\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415054 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-sys\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415054 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-proc\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-podres\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9q8z\" (UniqueName: \"kubernetes.io/projected/e380aa03-48a9-4508-95e0-b4797f2d43b3-kube-api-access-r9q8z\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415146 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-sys\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415153 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-proc\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-lib-modules\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415290 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415217 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-podres\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.415486 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.415298 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e380aa03-48a9-4508-95e0-b4797f2d43b3-lib-modules\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.423591 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.423560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9q8z\" (UniqueName: \"kubernetes.io/projected/e380aa03-48a9-4508-95e0-b4797f2d43b3-kube-api-access-r9q8z\") pod \"perf-node-gather-daemonset-rwljj\" (UID: \"e380aa03-48a9-4508-95e0-b4797f2d43b3\") " pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.522322 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.522238 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.651329 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.651305 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj"] Jul 22 17:11:14.653784 ip-10-0-143-30 kubenswrapper[2574]: W0722 17:11:14.653750 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode380aa03_48a9_4508_95e0_b4797f2d43b3.slice/crio-e5a88a6dadf44d5397449437ee36fd1903acf947704b93be6b81ff5619938ea9 WatchSource:0}: Error finding container e5a88a6dadf44d5397449437ee36fd1903acf947704b93be6b81ff5619938ea9: Status 404 returned error can't find the container with id e5a88a6dadf44d5397449437ee36fd1903acf947704b93be6b81ff5619938ea9 Jul 22 17:11:14.866208 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.866110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" event={"ID":"e380aa03-48a9-4508-95e0-b4797f2d43b3","Type":"ContainerStarted","Data":"7fbaa2753a44c48e078b40fe62a80deb4186462c4f31cd8b6912330e3b939f26"} Jul 22 17:11:14.866208 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.866197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:14.866431 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.866244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" event={"ID":"e380aa03-48a9-4508-95e0-b4797f2d43b3","Type":"ContainerStarted","Data":"e5a88a6dadf44d5397449437ee36fd1903acf947704b93be6b81ff5619938ea9"} Jul 22 17:11:14.883301 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:14.883258 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" podStartSLOduration=0.883242787 podStartE2EDuration="883.242787ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:11:14.881373636 +0000 UTC m=+3011.634309798" watchObservedRunningTime="2026-07-22 17:11:14.883242787 +0000 UTC m=+3011.636179224" Jul 22 17:11:15.563554 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:15.563513 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-9jhkh_554a1251-d900-4c0b-9742-f4ece24c7478/networking-console-plugin/0.log" Jul 22 17:11:18.184660 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:18.184626 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2hvwb_f1f7e419-b504-4942-b5d7-75c4d98cd8ac/dns/0.log" Jul 22 17:11:18.210892 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:18.210864 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2hvwb_f1f7e419-b504-4942-b5d7-75c4d98cd8ac/kube-rbac-proxy/0.log" Jul 22 17:11:18.498148 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:18.498076 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5w78n_07b9e9f0-f2c0-4700-bf95-ab445d7d3830/dns-node-resolver/0.log" Jul 22 17:11:19.434479 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:19.434444 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9vrh9_95140c89-1077-4a8c-be4c-4a72f2b3784a/node-ca/0.log" Jul 22 17:11:20.547298 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:20.547268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789t6xg_be5b6faa-722c-45a4-8636-c6f37c42a352/istio-proxy/0.log" Jul 22 17:11:20.785477 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:20.785442 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rxh6w_8f33ace9-cbe1-4643-8d03-e3161e077bff/discovery/0.log" Jul 22 17:11:20.880248 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:20.880172 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dg96g/perf-node-gather-daemonset-rwljj" Jul 22 17:11:20.910539 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:20.910503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/0.log" Jul 22 17:11:20.962357 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:20.962325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/1.log" Jul 22 17:11:21.088346 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:21.088318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4cqhk_bb045d52-53ac-4501-926c-36813ce1e58a/payload-processing/0.log" Jul 22 17:11:22.000161 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:22.000105 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qvv4v_527a74b0-5b63-4ec9-94f8-c865104d7351/serve-healthcheck-canary/0.log" Jul 22 17:11:22.605020 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:22.604991 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffgh6_d2fb2417-b18e-49c5-82fb-9736e68a5df3/kube-rbac-proxy/0.log" Jul 22 17:11:22.626114 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:22.626091 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffgh6_d2fb2417-b18e-49c5-82fb-9736e68a5df3/exporter/0.log" Jul 22 17:11:22.648082 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:22.648061 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffgh6_d2fb2417-b18e-49c5-82fb-9736e68a5df3/extractor/0.log" Jul 22 17:11:24.496806 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:24.496730 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789t6xg_be5b6faa-722c-45a4-8636-c6f37c42a352/istio-proxy/0.log" Jul 22 17:11:24.717418 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:24.717384 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rxh6w_8f33ace9-cbe1-4643-8d03-e3161e077bff/discovery/0.log" Jul 22 17:11:24.790374 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:24.790274 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/0.log" Jul 22 17:11:24.846086 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:24.846060 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/1.log" Jul 22 17:11:24.899208 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:24.899178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4cqhk_bb045d52-53ac-4501-926c-36813ce1e58a/payload-processing/0.log" Jul 22 17:11:25.883780 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:25.883745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76b7cff57-dchrb_c01efc96-1a3d-4900-b342-1cb7a59dbfb3/manager/0.log" Jul 22 17:11:26.120505 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.120475 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789t6xg_be5b6faa-722c-45a4-8636-c6f37c42a352/istio-proxy/0.log" Jul 22 17:11:26.380921 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.380893 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-s5lgh_ee016641-9aa0-4ebf-a5c2-8fee04ed8bec/manager/0.log" Jul 22 17:11:26.383559 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.383530 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rxh6w_8f33ace9-cbe1-4643-8d03-e3161e077bff/discovery/0.log" Jul 22 17:11:26.398395 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.398376 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb6494f8-s5lgh_ee016641-9aa0-4ebf-a5c2-8fee04ed8bec/copy-manifests/0.log" Jul 22 17:11:26.437543 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.437520 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/0.log" Jul 22 17:11:26.489700 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.489655 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xkn7g_3d69805f-7b44-4ac9-973f-e3e52d8358c6/istio-proxy/1.log" Jul 22 17:11:26.561088 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:26.561025 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-4cqhk_bb045d52-53ac-4501-926c-36813ce1e58a/payload-processing/0.log" Jul 22 17:11:27.710368 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:27.710341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66c589788b-9z6l6_0a942ca9-6c51-4478-bef8-0a6aef4c70ec/manager/0.log" Jul 22 17:11:27.736424 ip-10-0-143-30 kubenswrapper[2574]: I0722 17:11:27.736398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dm7ff_e93d4efc-f94d-47b6-8554-3444ba031a0b/openshift-lws-operator/0.log"