Jul 22 01:47:20.931807 ip-10-0-143-108 systemd[1]: Starting Kubernetes Kubelet... Jul 22 01:47:21.387052 ip-10-0-143-108 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:47:21.387052 ip-10-0-143-108 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 01:47:21.387052 ip-10-0-143-108 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:47:21.387052 ip-10-0-143-108 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 01:47:21.387052 ip-10-0-143-108 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 01:47:21.389312 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.389203 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 01:47:21.395774 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395759 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:21.395774 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395775 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395779 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395783 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395786 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395788 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395791 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395794 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395796 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395799 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395805 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395809 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395811 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395814 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395817 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395821 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395825 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395828 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395831 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395833 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395836 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:21.395848 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395838 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395841 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395844 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395846 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395849 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395852 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395855 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395858 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395862 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395865 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395867 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395870 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395873 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395876 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395878 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395881 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395883 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395886 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395888 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395890 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:21.396318 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395893 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395895 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395898 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395901 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395904 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395907 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395911 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395914 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395916 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395919 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395929 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395932 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395934 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395937 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395940 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395942 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395945 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395948 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395951 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:21.396951 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395953 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395956 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395959 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395961 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395964 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395966 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395968 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395971 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395973 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395976 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395978 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395981 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395983 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395986 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395988 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395991 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395995 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.395998 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396001 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396003 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:21.397417 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396006 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396008 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396011 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396013 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396016 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396019 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396021 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396024 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396027 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396030 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396033 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396035 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396038 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396041 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396043 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396046 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396048 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396052 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:21.397908 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.396055 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397615 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397624 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397629 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397633 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397636 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397639 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397642 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397645 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397647 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397650 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397656 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397659 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397662 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397664 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397666 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397669 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397672 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397675 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:21.398324 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397678 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397682 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397684 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397687 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397689 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397692 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397694 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397697 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397699 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397702 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397705 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397707 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397710 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397713 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397715 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397718 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397720 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397723 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397725 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:21.398832 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397727 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397730 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397732 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397734 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397737 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397740 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397742 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397745 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397747 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397751 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397753 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397756 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397758 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397763 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397767 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397770 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397772 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397775 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397777 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397780 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:21.399298 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397783 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397786 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397788 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397791 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397793 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397796 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397798 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397800 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397803 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397805 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397808 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397810 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397813 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397815 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397818 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397820 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397823 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397825 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397828 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397831 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:21.399798 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397834 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397837 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397839 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397842 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397845 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397847 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397850 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397853 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397855 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397858 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397861 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397864 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397866 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397869 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397871 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397873 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397876 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397878 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397881 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397883 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:21.400291 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397885 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.397888 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398312 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398318 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398321 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398325 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398328 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398331 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398335 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398338 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398340 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398344 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398347 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398350 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398352 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398355 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398358 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398361 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398364 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:21.400800 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398367 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398370 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398373 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398376 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398378 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398380 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398383 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398385 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398389 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398393 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398396 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398399 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398402 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398404 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398406 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398409 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398412 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398414 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398418 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:21.401255 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398422 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398426 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398429 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398432 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398435 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398438 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398441 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398444 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398447 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398450 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398452 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398455 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398457 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398460 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398463 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398465 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398468 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398470 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398473 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:21.401713 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398475 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398478 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398480 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398483 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398485 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398488 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398490 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398492 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398495 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398497 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398500 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398502 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398521 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398525 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398530 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398532 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398535 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398537 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398540 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398543 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:21.402192 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398546 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398548 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398551 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398553 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398556 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398562 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398565 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398567 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398570 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398572 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398575 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398577 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398580 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398582 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398585 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398587 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398590 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398593 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398595 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398597 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:21.402676 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398600 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398602 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398604 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.398607 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398681 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398691 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398698 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398702 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398706 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398709 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398713 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398718 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398721 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398725 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398728 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398731 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398734 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398738 2554 flags.go:64] FLAG: --cgroup-root="" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398741 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398744 2554 flags.go:64] FLAG: --client-ca-file="" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398747 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398750 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398754 2554 flags.go:64] FLAG: --cluster-domain="" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398757 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 01:47:21.403140 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398760 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398763 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398766 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398770 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398773 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398776 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398779 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398782 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398785 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398788 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398791 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398798 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398802 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398805 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398808 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398811 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398814 2554 flags.go:64] FLAG: --enable-server="true" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398816 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398821 2554 flags.go:64] FLAG: --event-burst="100" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398824 2554 flags.go:64] FLAG: --event-qps="50" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398826 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398829 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398833 2554 flags.go:64] FLAG: --eviction-hard="" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398837 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 01:47:21.403779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398840 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398844 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398847 2554 flags.go:64] FLAG: --eviction-soft="" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398850 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398853 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398856 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398859 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398861 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398864 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398879 2554 flags.go:64] FLAG: --feature-gates="" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398883 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398887 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398890 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398894 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398896 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398899 2554 flags.go:64] FLAG: --help="false" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398903 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398906 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398909 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398912 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398916 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398919 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398922 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 01:47:21.404355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398924 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398927 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398930 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398933 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398936 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398939 2554 flags.go:64] FLAG: --kube-reserved="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398941 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398944 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398948 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398951 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398955 2554 flags.go:64] FLAG: --lock-file="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398958 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398960 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398963 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398968 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398971 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398974 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398977 2554 flags.go:64] FLAG: --logging-format="text" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398979 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398982 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398985 2554 flags.go:64] FLAG: --manifest-url="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398988 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398992 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398995 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.398999 2554 flags.go:64] FLAG: --max-pods="110" Jul 22 01:47:21.404963 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399002 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399005 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399008 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399012 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399015 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399017 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399020 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399027 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399030 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399033 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399037 2554 flags.go:64] FLAG: --pod-cidr="" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399039 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399045 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399048 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399051 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399054 2554 flags.go:64] FLAG: --port="10250" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399058 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399061 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-038bd2986eabc4e60" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399065 2554 flags.go:64] FLAG: --qos-reserved="" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399068 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399071 2554 flags.go:64] FLAG: --register-node="true" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399074 2554 flags.go:64] FLAG: --register-with-taints="" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399077 2554 flags.go:64] FLAG: --registry-burst="10" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399080 2554 flags.go:64] FLAG: --registry-qps="5" Jul 22 01:47:21.405640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399083 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399085 2554 flags.go:64] FLAG: --reserved-memory="" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399089 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399092 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399094 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399097 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399100 2554 flags.go:64] FLAG: --runonce="false" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399103 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399106 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399108 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399111 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399115 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399118 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399121 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399124 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399127 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399130 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399133 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399135 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399138 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399141 2554 flags.go:64] FLAG: --system-cgroups="" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399143 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399149 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399151 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399154 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 01:47:21.406221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399159 2554 flags.go:64] FLAG: --tls-min-version="" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399163 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399166 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399169 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399171 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399174 2554 flags.go:64] FLAG: --v="2" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399178 2554 flags.go:64] FLAG: --version="false" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399182 2554 flags.go:64] FLAG: --vmodule="" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399185 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.399188 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399302 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399305 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399309 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399312 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399315 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399318 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399321 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399323 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399327 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399330 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399332 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399335 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:21.406855 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399337 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399340 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399342 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399345 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399347 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399350 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399352 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399355 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399357 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399360 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399362 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399366 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399368 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399370 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399373 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399375 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399378 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399380 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399382 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399385 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:21.407652 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399387 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399390 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399392 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399395 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399397 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399399 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399402 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399404 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399407 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399410 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399413 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399416 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399420 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399422 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399425 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399428 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399430 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399433 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399436 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:21.408359 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399438 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399441 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399443 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399446 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399448 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399451 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399454 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399457 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399461 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399464 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399466 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399468 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399471 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399473 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399475 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399478 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399480 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399483 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399485 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:21.408845 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399487 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399490 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399493 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399496 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399498 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399501 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399520 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399525 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399529 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399533 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399537 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399541 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399546 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399549 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399553 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399556 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399559 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399562 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399565 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:21.409311 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399569 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399572 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399574 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399577 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399579 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399582 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399584 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399588 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399590 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.399592 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.400306 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.409331 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.409347 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.409367 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.409373 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 01:47:21.409799 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409430 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409435 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409438 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409441 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409444 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409446 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409449 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409452 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409454 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409457 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409460 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409462 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409465 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409467 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409470 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409472 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409475 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409477 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409480 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409482 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:21.410172 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409486 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409490 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409493 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409496 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409499 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409502 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409519 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409522 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409524 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409528 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409531 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409534 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409537 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409539 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409542 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409545 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409547 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409550 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409552 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409555 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:21.410659 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409557 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409560 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409562 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409565 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409568 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409570 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409573 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409575 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409578 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409580 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409583 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409585 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409588 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409590 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409593 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409595 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409598 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409601 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409603 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409606 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:21.411179 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409608 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409611 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409614 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409617 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409620 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409622 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409625 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409627 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409630 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409633 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409635 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409639 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409643 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409646 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409648 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409651 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409654 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409656 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409659 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409662 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:21.411663 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409665 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409668 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409670 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409673 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409677 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409680 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409683 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409686 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409689 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409691 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409694 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409697 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409699 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409702 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409705 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409707 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409710 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409713 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:21.412155 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409715 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.409721 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409830 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409836 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409839 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409842 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409844 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409847 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409849 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409852 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409854 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409857 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409859 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409861 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409869 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 01:47:21.412609 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409871 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409874 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409877 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409879 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409882 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409884 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409887 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409890 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409893 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409895 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409897 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409900 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409902 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409906 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409910 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409912 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409915 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409918 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409920 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409923 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 01:47:21.412976 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409925 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409928 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409932 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409935 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409938 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409940 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409943 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409945 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409948 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409950 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409953 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409955 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409958 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409961 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409963 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409966 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409968 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409970 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409973 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 01:47:21.413482 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409975 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409978 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409980 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409983 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409986 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409988 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409990 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409993 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409995 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.409998 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410001 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410003 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410006 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410008 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410010 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410013 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410015 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410018 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410020 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410022 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 01:47:21.414028 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410025 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410027 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410030 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410034 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410037 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410040 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410044 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410046 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410049 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410051 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410054 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410057 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410060 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410062 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410065 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410068 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410070 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410073 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410075 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 01:47:21.414502 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410078 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410080 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410083 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410085 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410087 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410090 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410092 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:21.410095 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.410099 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.410202 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 01:47:21.414960 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.413595 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 01:47:21.415317 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.415305 2554 server.go:1019] "Starting client certificate rotation" Jul 22 01:47:21.415430 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.415412 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:47:21.415458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.415448 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 01:47:21.418139 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.418125 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:47:21.420926 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.420910 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 01:47:21.434957 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.434939 2554 log.go:25] "Validated CRI v1 runtime API" Jul 22 01:47:21.437414 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.437398 2554 log.go:25] "Validated CRI v1 image API" Jul 22 01:47:21.438199 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.438184 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 01:47:21.440849 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.440821 2554 fs.go:135] Filesystem UUIDs: map[11250918-3678-44eb-ac51-60a14d6b683a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 937ac69f-89ea-4dd0-99dd-376922feb151:/dev/nvme0n1p3] Jul 22 01:47:21.440920 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.440847 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 01:47:21.445900 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.445789 2554 manager.go:216] Machine: {Timestamp:2026-07-22 01:47:21.444340066 +0000 UTC m=+0.384307319 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101322 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b6c8057275e4ac16d15d423aabbaa SystemUUID:ec2b6c80-5727-5e4a-c16d-15d423aabbaa BootID:6d1084c7-f53f-4690-bfcc-42eccc50a0df Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:bd:46:39:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:bd:46:39:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:67:76:61:5b:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 01:47:21.445900 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.445892 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 01:47:21.446006 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.445971 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 01:47:21.447308 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.447281 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:47:21.450060 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.449866 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 01:47:21.450198 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.450064 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 01:47:21.450881 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.450870 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 01:47:21.450913 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.450884 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 01:47:21.450913 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.450892 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:47:21.450913 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.450906 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 01:47:21.452813 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.452802 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 01:47:21.457278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457267 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:47:21.457400 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457391 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 01:47:21.457429 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457422 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 22 01:47:21.457459 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457433 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 01:47:21.457459 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457449 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 01:47:21.457459 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457459 2554 kubelet.go:398] "Adding apiserver pod source" Jul 22 01:47:21.457567 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457474 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 01:47:21.457853 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457841 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:47:21.457901 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.457860 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 01:47:21.460101 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.460081 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 01:47:21.462410 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.462396 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 01:47:21.462459 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.462427 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 01:47:21.463928 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463911 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 01:47:21.463971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463935 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 01:47:21.463971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463942 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 01:47:21.463971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463948 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 01:47:21.463971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463956 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 01:47:21.463971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463962 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 01:47:21.463971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463971 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 01:47:21.464158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463976 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 01:47:21.464158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463984 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 01:47:21.464158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.463989 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 01:47:21.464158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.464002 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 01:47:21.464158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.464008 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 01:47:21.464855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.464845 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 01:47:21.464892 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.464857 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 01:47:21.467873 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.467849 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 01:47:21.467948 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.467894 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 01:47:21.467993 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.467955 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 01:47:21.468180 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.468168 2554 server.go:1268] "Started kubelet" Jul 22 01:47:21.468259 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.468235 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 01:47:21.468350 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.468259 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 01:47:21.468411 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.468375 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 01:47:21.468977 ip-10-0-143-108 systemd[1]: Started Kubernetes Kubelet. Jul 22 01:47:21.470258 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.470242 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 22 01:47:21.470563 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.470533 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 01:47:21.473368 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.473336 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 01:47:21.478659 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.477541 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18c479685bbb8a17 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-07-22 01:47:21.468135959 +0000 UTC m=+0.408103210,LastTimestamp:2026-07-22 01:47:21.468135959 +0000 UTC m=+0.408103210,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jul 22 01:47:21.479530 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.479495 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 01:47:21.480174 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.479490 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 01:47:21.480479 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.480459 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.481084 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481065 2554 factory.go:55] Registering systemd factory Jul 22 01:47:21.481084 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481088 2554 factory.go:223] Registration of the systemd container factory successfully Jul 22 01:47:21.481233 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481156 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 01:47:21.481233 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481159 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 01:47:21.481233 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481176 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 01:47:21.481348 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481291 2554 factory.go:153] Registering CRI-O factory Jul 22 01:47:21.481348 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481305 2554 factory.go:223] Registration of the crio container factory successfully Jul 22 01:47:21.481426 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481293 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 22 01:47:21.481426 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481376 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 01:47:21.481426 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481385 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 22 01:47:21.481426 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481395 2554 factory.go:103] Registering Raw factory Jul 22 01:47:21.481426 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.481406 2554 manager.go:1196] Started watching for new ooms in manager Jul 22 01:47:21.482086 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.482072 2554 manager.go:349] Starting recovery of all containers Jul 22 01:47:21.482380 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.482353 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 01:47:21.482690 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.482660 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 01:47:21.493309 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.493290 2554 manager.go:354] Recovery completed Jul 22 01:47:21.497116 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.497092 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lgrzt" Jul 22 01:47:21.497667 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.497469 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.499565 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.499547 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.499637 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.499584 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.499637 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.499594 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.500121 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500104 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 01:47:21.500121 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500121 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 01:47:21.500220 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500123 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.500220 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500139 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 22 01:47:21.500967 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500955 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.501027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500981 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.501027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.500990 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.502310 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.502299 2554 policy_none.go:49] "None policy: Start" Jul 22 01:47:21.502346 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.502314 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 01:47:21.502346 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.502324 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 01:47:21.504256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.504245 2554 policy_none.go:47] "Start" Jul 22 01:47:21.505232 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.505204 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lgrzt" Jul 22 01:47:21.509945 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.509867 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18c479685d9b15cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-07-22 01:47:21.499563468 +0000 UTC m=+0.439530719,LastTimestamp:2026-07-22 01:47:21.499563468 +0000 UTC m=+0.439530719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jul 22 01:47:21.535150 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535133 2554 manager.go:337] "Starting Device Plugin manager" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.535171 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535181 2554 server.go:87] "Starting device plugin registration server" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535414 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535426 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535537 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535624 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.535632 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.536186 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.536237 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.556886 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.558246 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.558288 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.558310 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 01:47:21.560715 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.558340 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 01:47:21.561398 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.561079 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:21.636324 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.636283 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.637313 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.637247 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.637313 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.637285 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.637313 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.637299 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.637498 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.637331 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.645502 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.645486 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.645581 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.645523 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-108.ec2.internal\": node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.659051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.659026 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal"] Jul 22 01:47:21.659130 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.659092 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.659942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.659919 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.659991 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.659959 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.659991 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.659974 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.662367 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.662354 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.662486 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.662472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.662540 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.662499 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.663042 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.663022 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.663042 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.663020 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.663157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.663053 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.663157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.663067 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.663157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.663054 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.663157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.663147 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.665355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.665342 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.665401 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.665373 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:21.666005 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.665989 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:21.666101 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.666019 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:21.666101 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.666035 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:21.683074 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.683053 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63877844a9a70797bbd7b58b4360d66f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"63877844a9a70797bbd7b58b4360d66f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.683180 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.683081 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63877844a9a70797bbd7b58b4360d66f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"63877844a9a70797bbd7b58b4360d66f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.683180 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.683098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/004580757f306e7a3c43a8130fcf2570-config\") pod \"kube-apiserver-proxy-ip-10-0-143-108.ec2.internal\" (UID: \"004580757f306e7a3c43a8130fcf2570\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.693091 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.693024 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.693271 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.693255 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-108.ec2.internal\" not found" node="ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.697674 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.697657 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-108.ec2.internal\" not found" node="ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.783489 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.783448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63877844a9a70797bbd7b58b4360d66f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"63877844a9a70797bbd7b58b4360d66f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.783657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.783494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63877844a9a70797bbd7b58b4360d66f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"63877844a9a70797bbd7b58b4360d66f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.783657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.783540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/004580757f306e7a3c43a8130fcf2570-config\") pod \"kube-apiserver-proxy-ip-10-0-143-108.ec2.internal\" (UID: \"004580757f306e7a3c43a8130fcf2570\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.783657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.783554 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63877844a9a70797bbd7b58b4360d66f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"63877844a9a70797bbd7b58b4360d66f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.783657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.783563 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63877844a9a70797bbd7b58b4360d66f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"63877844a9a70797bbd7b58b4360d66f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.783657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.783569 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/004580757f306e7a3c43a8130fcf2570-config\") pod \"kube-apiserver-proxy-ip-10-0-143-108.ec2.internal\" (UID: \"004580757f306e7a3c43a8130fcf2570\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jul 22 01:47:21.793567 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.793543 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.893736 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.893672 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.994547 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:21.994492 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:21.998670 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:21.998651 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:22.002486 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.002472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jul 22 01:47:22.094761 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.094709 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.195360 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.195292 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.295818 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.295781 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.396404 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.396368 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.412783 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.412761 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:22.414413 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.414401 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 01:47:22.414517 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.414492 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:47:22.414557 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.414519 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 01:47:22.496736 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.496660 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.500636 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.500609 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:22.511583 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.511548 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 01:42:22 +0000 UTC" deadline="2028-04-28 20:51:11.347015546 +0000 UTC" Jul 22 01:47:22.511583 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.511577 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15523h3m48.835441387s" Jul 22 01:47:22.597251 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.597222 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.600345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.600321 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 01:47:22.601713 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.601692 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jul 22 01:47:22.601835 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.601729 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 01:47:22.601835 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.601743 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jul 22 01:47:22.677259 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:22.677228 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004580757f306e7a3c43a8130fcf2570.slice/crio-b61ee02d5f71425663581c7e08246d478a57e4c6e52e71c408bf1690c425c358 WatchSource:0}: Error finding container b61ee02d5f71425663581c7e08246d478a57e4c6e52e71c408bf1690c425c358: Status 404 returned error can't find the container with id b61ee02d5f71425663581c7e08246d478a57e4c6e52e71c408bf1690c425c358 Jul 22 01:47:22.677751 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:22.677731 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63877844a9a70797bbd7b58b4360d66f.slice/crio-6c6a64815b9b038377eb80e1a74c27708036d6355f0890c8f2f9141e2f0c56b6 WatchSource:0}: Error finding container 6c6a64815b9b038377eb80e1a74c27708036d6355f0890c8f2f9141e2f0c56b6: Status 404 returned error can't find the container with id 6c6a64815b9b038377eb80e1a74c27708036d6355f0890c8f2f9141e2f0c56b6 Jul 22 01:47:22.682765 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.682747 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:47:22.697569 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.697544 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.798226 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.798140 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.898677 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:22.898645 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jul 22 01:47:22.905389 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.905372 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:22.981574 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.981527 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jul 22 01:47:22.993523 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.993479 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:47:22.994717 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:22.994701 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jul 22 01:47:23.000737 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.000718 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 01:47:23.459350 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.458765 2554 apiserver.go:52] "Watching apiserver" Jul 22 01:47:23.467836 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.467797 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 01:47:23.468366 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.468338 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-98ngj","openshift-multus/multus-additional-cni-plugins-z8gbf","openshift-multus/multus-xv99m","openshift-multus/network-metrics-daemon-4zgdb","openshift-ovn-kubernetes/ovnkube-node-zgmvf","kube-system/global-pull-secret-syncer-9p4g6","kube-system/konnectivity-agent-fxx9x","kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal","openshift-network-diagnostics/network-check-target-8cvrx","openshift-network-operator/iptables-alerter-sxfpz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s","openshift-cluster-node-tuning-operator/tuned-xdddc","openshift-dns/node-resolver-t7nlt"] Jul 22 01:47:23.471271 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.471246 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.473745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.473595 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.474285 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.474027 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 01:47:23.474285 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.474137 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 01:47:23.474285 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.474189 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2f8g8\"" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.475834 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.476446 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.478677 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zqlx4\"" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479025 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479434 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rt8gk\"" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479491 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 01:47:23.479708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.480111 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479763 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.480111 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479881 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 01:47:23.480111 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.479950 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:23.480111 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.480018 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:23.480880 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.480859 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 01:47:23.482067 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.482035 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.484669 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.484777 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.485339 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.485503 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.485671 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.485909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pm2n6\"" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.486448 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 01:47:23.486683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.486490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.487135 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.486716 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 01:47:23.487135 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.486878 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.490299 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.489178 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.490299 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.490000 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.490299 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.490210 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wnsk7\"" Jul 22 01:47:23.490512 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.490378 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.491903 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.491588 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 01:47:23.491903 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.491849 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gg4rm\"" Jul 22 01:47:23.496232 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.495940 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.496232 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496030 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 01:47:23.496392 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496347 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.496719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496554 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa8f0250-d592-456e-b0a8-26a7e9277844-agent-certs\") pod \"konnectivity-agent-fxx9x\" (UID: \"aa8f0250-d592-456e-b0a8-26a7e9277844\") " pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.496719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496589 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.496719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496618 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:23.496719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysctl-d\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.496719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwszh\" (UniqueName: \"kubernetes.io/projected/3547a4a3-ea1e-46d5-9993-ceb85f411e41-kube-api-access-rwszh\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.496719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-conf-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-run-netns\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovn-node-metrics-cert\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496932 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-tuned\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.496974 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.496993 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnhtl\" (UniqueName: \"kubernetes.io/projected/15fa3782-0966-4522-a79f-79917f4dfd4c-kube-api-access-pnhtl\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:23.497066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-kubelet\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-env-overrides\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-run\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.497421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdxfq\" (UniqueName: \"kubernetes.io/projected/1f491b8d-15e9-40dc-870b-157296ca3b0a-kube-api-access-hdxfq\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-cni-bin\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.497421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-ovn\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysconfig\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.497732 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-etc-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497732 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovnkube-config\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.497732 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-kubernetes\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.497732 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.497670 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.498104 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-host\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-netns\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-cni-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498390 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2be73834-331a-439e-afe5-7cefab57fa42-multus-daemon-config\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-etc-kubernetes\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498451 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-var-lib-kubelet\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2be73834-331a-439e-afe5-7cefab57fa42-cni-binary-copy\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-k8s-cni-cncf-io\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-var-lib-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-lib-modules\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-systemd-units\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysctl-conf\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498883 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3547a4a3-ea1e-46d5-9993-ceb85f411e41-tmp\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-system-cni-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.498990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-os-release\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-kubelet\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.499051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-hostroot\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a104096-a728-4057-b64c-19adf6c03586-dbus\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499127 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-systemd\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499184 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-sys\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc8r7\" (UniqueName: \"kubernetes.io/projected/2be73834-331a-439e-afe5-7cefab57fa42-kube-api-access-sc8r7\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499272 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-node-log\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499365 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovnkube-script-lib\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-cni-multus\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499428 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa8f0250-d592-456e-b0a8-26a7e9277844-konnectivity-ca\") pod \"konnectivity-agent-fxx9x\" (UID: \"aa8f0250-d592-456e-b0a8-26a7e9277844\") " pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-cnibin\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499549 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-slash\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-cni-bin\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499641 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-modprobe-d\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.500305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499672 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-socket-dir-parent\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.500998 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-cni-netd\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500998 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-multus-certs\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.500998 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-systemd\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500998 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-log-socket\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.500998 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.499960 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a104096-a728-4057-b64c-19adf6c03586-kubelet-config\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.502357 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.501423 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7kvf\"" Jul 22 01:47:23.502357 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.501516 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.502357 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.501570 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 01:47:23.502357 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.501829 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.502357 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.501940 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sfnlg\"" Jul 22 01:47:23.502762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.502453 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.502762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.502491 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 01:47:23.504027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.503742 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 01:47:23.506256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.505590 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 01:47:23.506256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.505611 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pgbfd\"" Jul 22 01:47:23.506256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.505821 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 01:47:23.506256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.506157 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 01:47:23.523069 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.523008 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5lr4" Jul 22 01:47:23.531171 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.531146 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5lr4" Jul 22 01:47:23.566689 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.566644 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" event={"ID":"004580757f306e7a3c43a8130fcf2570","Type":"ContainerStarted","Data":"b61ee02d5f71425663581c7e08246d478a57e4c6e52e71c408bf1690c425c358"} Jul 22 01:47:23.568074 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.568043 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" event={"ID":"63877844a9a70797bbd7b58b4360d66f","Type":"ContainerStarted","Data":"6c6a64815b9b038377eb80e1a74c27708036d6355f0890c8f2f9141e2f0c56b6"} Jul 22 01:47:23.569272 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.569250 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:23.582296 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.582273 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 01:47:23.600763 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600734 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-sys-fs\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.600763 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-run\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdxfq\" (UniqueName: \"kubernetes.io/projected/1f491b8d-15e9-40dc-870b-157296ca3b0a-kube-api-access-hdxfq\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87deed16-ac17-4ab0-bffe-c4072110040b-iptables-alerter-script\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xsmk\" (UniqueName: \"kubernetes.io/projected/8cbabdd9-b920-4219-ba7e-0656628d05d8-kube-api-access-9xsmk\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-cni-bin\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-ovn\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-os-release\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.600953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8cbabdd9-b920-4219-ba7e-0656628d05d8-serviceca\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.601066 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5bs\" (UniqueName: \"kubernetes.io/projected/ef58141b-d9d5-431e-bfd8-9100198fcc32-kube-api-access-mh5bs\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysconfig\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-etc-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovnkube-config\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-cnibin\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-kubernetes\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601246 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-host\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-netns\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79jj\" (UniqueName: \"kubernetes.io/projected/754f03ce-1f47-4f19-b188-e4f4c7f28d43-kube-api-access-d79jj\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601331 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-registration-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601356 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-system-cni-dir\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-cni-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2be73834-331a-439e-afe5-7cefab57fa42-multus-daemon-config\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-etc-kubernetes\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601477 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87deed16-ac17-4ab0-bffe-c4072110040b-host-slash\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.601533 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-var-lib-kubelet\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601535 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2be73834-331a-439e-afe5-7cefab57fa42-cni-binary-copy\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-k8s-cni-cncf-io\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-var-lib-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601648 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-lib-modules\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-systemd-units\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/754f03ce-1f47-4f19-b188-e4f4c7f28d43-tmp-dir\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601843 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysctl-conf\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3547a4a3-ea1e-46d5-9993-ceb85f411e41-tmp\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-system-cni-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-os-release\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.601998 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-kubelet\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-hostroot\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.602391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a104096-a728-4057-b64c-19adf6c03586-dbus\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-systemd\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-sys\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602161 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc8r7\" (UniqueName: \"kubernetes.io/projected/2be73834-331a-439e-afe5-7cefab57fa42-kube-api-access-sc8r7\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-node-log\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovnkube-script-lib\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-cni-multus\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602336 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/754f03ce-1f47-4f19-b188-e4f4c7f28d43-hosts-file\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cbabdd9-b920-4219-ba7e-0656628d05d8-host\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa8f0250-d592-456e-b0a8-26a7e9277844-konnectivity-ca\") pod \"konnectivity-agent-fxx9x\" (UID: \"aa8f0250-d592-456e-b0a8-26a7e9277844\") " pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-cnibin\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-slash\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-cni-bin\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.603277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-modprobe-d\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-socket-dir-parent\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-cni-netd\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602730 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vl4\" (UniqueName: \"kubernetes.io/projected/badc808f-7fd9-4463-8d2a-cc1882c0981b-kube-api-access-59vl4\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602759 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6kd\" (UniqueName: \"kubernetes.io/projected/87deed16-ac17-4ab0-bffe-c4072110040b-kube-api-access-6h6kd\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-multus-certs\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-systemd\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-log-socket\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-device-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.602972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a104096-a728-4057-b64c-19adf6c03586-kubelet-config\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa8f0250-d592-456e-b0a8-26a7e9277844-agent-certs\") pod \"konnectivity-agent-fxx9x\" (UID: \"aa8f0250-d592-456e-b0a8-26a7e9277844\") " pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysctl-d\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwszh\" (UniqueName: \"kubernetes.io/projected/3547a4a3-ea1e-46d5-9993-ceb85f411e41-kube-api-access-rwszh\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603135 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-conf-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-run-netns\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovn-node-metrics-cert\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-tuned\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnhtl\" (UniqueName: \"kubernetes.io/projected/15fa3782-0966-4522-a79f-79917f4dfd4c-kube-api-access-pnhtl\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-kubelet\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-env-overrides\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603392 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-socket-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603576 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-run\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.603970 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-cni-bin\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.604044 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-ovn\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.604169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysconfig\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.604216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-etc-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.604969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.604903 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovnkube-config\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.605628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.605018 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-kubernetes\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.605628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.605077 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-host\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.605628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.605122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-netns\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.605628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.605297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-cni-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.605889 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.605858 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2be73834-331a-439e-afe5-7cefab57fa42-multus-daemon-config\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606012 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.605971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-hostroot\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606081 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606017 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606136 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606071 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-system-cni-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606136 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.606100 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:23.606242 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606144 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-var-lib-kubelet\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.606242 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.606184 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:47:24.10615082 +0000 UTC m=+3.046118083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:23.606242 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606212 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a104096-a728-4057-b64c-19adf6c03586-kubelet-config\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.606242 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606235 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-kubelet\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606253 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-cni-bin\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606276 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-k8s-cni-cncf-io\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606283 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-slash\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606311 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 01:47:23.606458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606395 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-modprobe-d\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.606739 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606465 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-socket-dir-parent\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606739 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606520 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-cni-netd\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606739 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606526 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2be73834-331a-439e-afe5-7cefab57fa42-cni-binary-copy\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606739 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606679 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-etc-kubernetes\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606739 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a104096-a728-4057-b64c-19adf6c03586-dbus\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606776 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-systemd\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606745 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-env-overrides\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606849 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606869 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-sys\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-node-log\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606906 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-kubelet\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606945 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-var-lib-cni-multus\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.606981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606951 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-run-netns\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607003 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607026 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-log-socket\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607060 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-run-systemd\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607098 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa8f0250-d592-456e-b0a8-26a7e9277844-konnectivity-ca\") pod \"konnectivity-agent-fxx9x\" (UID: \"aa8f0250-d592-456e-b0a8-26a7e9277844\") " pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607098 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-host-run-multus-certs\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607166 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-cnibin\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.607418 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-multus-conf-dir\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.607747 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607564 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-lib-modules\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.607747 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.606529 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:23.607747 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607630 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysctl-conf\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.607747 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2be73834-331a-439e-afe5-7cefab57fa42-os-release\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.607747 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovnkube-script-lib\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.607747 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.607695 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:24.107672958 +0000 UTC m=+3.047640222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:23.608005 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607745 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-systemd-units\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.608005 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.606324 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1f491b8d-15e9-40dc-870b-157296ca3b0a-var-lib-openvswitch\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.608005 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.607800 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-sysctl-d\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.610899 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.610869 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3547a4a3-ea1e-46d5-9993-ceb85f411e41-etc-tuned\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.611132 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.611079 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f491b8d-15e9-40dc-870b-157296ca3b0a-ovn-node-metrics-cert\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.611254 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.611214 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa8f0250-d592-456e-b0a8-26a7e9277844-agent-certs\") pod \"konnectivity-agent-fxx9x\" (UID: \"aa8f0250-d592-456e-b0a8-26a7e9277844\") " pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.611321 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.611257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3547a4a3-ea1e-46d5-9993-ceb85f411e41-tmp\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.616304 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.616277 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdxfq\" (UniqueName: \"kubernetes.io/projected/1f491b8d-15e9-40dc-870b-157296ca3b0a-kube-api-access-hdxfq\") pod \"ovnkube-node-zgmvf\" (UID: \"1f491b8d-15e9-40dc-870b-157296ca3b0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.617433 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.617025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwszh\" (UniqueName: \"kubernetes.io/projected/3547a4a3-ea1e-46d5-9993-ceb85f411e41-kube-api-access-rwszh\") pod \"tuned-xdddc\" (UID: \"3547a4a3-ea1e-46d5-9993-ceb85f411e41\") " pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.617433 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.617392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnhtl\" (UniqueName: \"kubernetes.io/projected/15fa3782-0966-4522-a79f-79917f4dfd4c-kube-api-access-pnhtl\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:23.619044 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.619019 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc8r7\" (UniqueName: \"kubernetes.io/projected/2be73834-331a-439e-afe5-7cefab57fa42-kube-api-access-sc8r7\") pod \"multus-xv99m\" (UID: \"2be73834-331a-439e-afe5-7cefab57fa42\") " pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.704572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-os-release\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.704572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704611 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8cbabdd9-b920-4219-ba7e-0656628d05d8-serviceca\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704639 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5bs\" (UniqueName: \"kubernetes.io/projected/ef58141b-d9d5-431e-bfd8-9100198fcc32-kube-api-access-mh5bs\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-cnibin\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79jj\" (UniqueName: \"kubernetes.io/projected/754f03ce-1f47-4f19-b188-e4f4c7f28d43-kube-api-access-d79jj\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704723 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-os-release\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-registration-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704801 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-registration-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.704848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704822 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-system-cni-dir\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87deed16-ac17-4ab0-bffe-c4072110040b-host-slash\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/754f03ce-1f47-4f19-b188-e4f4c7f28d43-tmp-dir\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704942 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-cnibin\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.704986 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/754f03ce-1f47-4f19-b188-e4f4c7f28d43-hosts-file\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705043 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-system-cni-dir\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cbabdd9-b920-4219-ba7e-0656628d05d8-host\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705075 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705125 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cbabdd9-b920-4219-ba7e-0656628d05d8-host\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59vl4\" (UniqueName: \"kubernetes.io/projected/badc808f-7fd9-4463-8d2a-cc1882c0981b-kube-api-access-59vl4\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6kd\" (UniqueName: \"kubernetes.io/projected/87deed16-ac17-4ab0-bffe-c4072110040b-kube-api-access-6h6kd\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-device-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.705306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-socket-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705229 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/badc808f-7fd9-4463-8d2a-cc1882c0981b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-sys-fs\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8cbabdd9-b920-4219-ba7e-0656628d05d8-serviceca\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87deed16-ac17-4ab0-bffe-c4072110040b-iptables-alerter-script\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xsmk\" (UniqueName: \"kubernetes.io/projected/8cbabdd9-b920-4219-ba7e-0656628d05d8-kube-api-access-9xsmk\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705343 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/754f03ce-1f47-4f19-b188-e4f4c7f28d43-tmp-dir\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705365 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-device-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/754f03ce-1f47-4f19-b188-e4f4c7f28d43-hosts-file\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705429 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-sys-fs\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705638 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705699 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87deed16-ac17-4ab0-bffe-c4072110040b-host-slash\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.705706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef58141b-d9d5-431e-bfd8-9100198fcc32-socket-dir\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.706018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.706018 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.706522 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.706029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/badc808f-7fd9-4463-8d2a-cc1882c0981b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.706976 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.706952 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87deed16-ac17-4ab0-bffe-c4072110040b-iptables-alerter-script\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.717516 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.716820 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:23.717516 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.716849 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:23.717516 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.716865 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:23.717516 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:23.716937 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:24.216917516 +0000 UTC m=+3.156884762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:23.721283 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.721236 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xsmk\" (UniqueName: \"kubernetes.io/projected/8cbabdd9-b920-4219-ba7e-0656628d05d8-kube-api-access-9xsmk\") pod \"node-ca-98ngj\" (UID: \"8cbabdd9-b920-4219-ba7e-0656628d05d8\") " pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.722286 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.722245 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79jj\" (UniqueName: \"kubernetes.io/projected/754f03ce-1f47-4f19-b188-e4f4c7f28d43-kube-api-access-d79jj\") pod \"node-resolver-t7nlt\" (UID: \"754f03ce-1f47-4f19-b188-e4f4c7f28d43\") " pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.722770 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.722740 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6kd\" (UniqueName: \"kubernetes.io/projected/87deed16-ac17-4ab0-bffe-c4072110040b-kube-api-access-6h6kd\") pod \"iptables-alerter-sxfpz\" (UID: \"87deed16-ac17-4ab0-bffe-c4072110040b\") " pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.723653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.723613 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5bs\" (UniqueName: \"kubernetes.io/projected/ef58141b-d9d5-431e-bfd8-9100198fcc32-kube-api-access-mh5bs\") pod \"aws-ebs-csi-driver-node-2mm9s\" (UID: \"ef58141b-d9d5-431e-bfd8-9100198fcc32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:23.723920 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.723898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vl4\" (UniqueName: \"kubernetes.io/projected/badc808f-7fd9-4463-8d2a-cc1882c0981b-kube-api-access-59vl4\") pod \"multus-additional-cni-plugins-z8gbf\" (UID: \"badc808f-7fd9-4463-8d2a-cc1882c0981b\") " pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.787324 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.787229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:23.801742 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.801712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xdddc" Jul 22 01:47:23.815077 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.815036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xv99m" Jul 22 01:47:23.829114 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.829080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:23.838299 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.838272 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t7nlt" Jul 22 01:47:23.846298 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.846276 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98ngj" Jul 22 01:47:23.856313 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.856291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sxfpz" Jul 22 01:47:23.867190 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.867168 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" Jul 22 01:47:23.874202 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:23.874183 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" Jul 22 01:47:24.108292 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.108192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:24.108292 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.108277 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:24.108549 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.108394 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:24.108549 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.108480 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:47:25.108457971 +0000 UTC m=+4.048425218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:24.108549 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.108394 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:24.108702 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.108581 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:25.108563796 +0000 UTC m=+4.048531037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:24.126896 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.126865 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 01:47:24.309506 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.309464 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:24.309697 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.309660 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:24.309697 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.309682 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:24.309697 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.309692 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:24.309839 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.309753 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:25.309732052 +0000 UTC m=+4.249699293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:24.535313 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.535218 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:42:24 +0000 UTC" deadline="2028-02-11 17:12:47.36998067 +0000 UTC" Jul 22 01:47:24.535313 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.535262 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13671h25m22.834724357s" Jul 22 01:47:24.558848 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:24.558820 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:24.559035 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:24.558946 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:24.718284 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:24.718255 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87deed16_ac17_4ab0_bffe_c4072110040b.slice/crio-fcb3f483f32a540b58551ef0c78ae240e892696c956172410302da183063cadf WatchSource:0}: Error finding container fcb3f483f32a540b58551ef0c78ae240e892696c956172410302da183063cadf: Status 404 returned error can't find the container with id fcb3f483f32a540b58551ef0c78ae240e892696c956172410302da183063cadf Jul 22 01:47:24.722584 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:24.722561 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3547a4a3_ea1e_46d5_9993_ceb85f411e41.slice/crio-34b43dce7512141c6aa29b45b0218a27da826f72316280a401a025da29fdf77c WatchSource:0}: Error finding container 34b43dce7512141c6aa29b45b0218a27da826f72316280a401a025da29fdf77c: Status 404 returned error can't find the container with id 34b43dce7512141c6aa29b45b0218a27da826f72316280a401a025da29fdf77c Jul 22 01:47:24.755993 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:24.755967 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef58141b_d9d5_431e_bfd8_9100198fcc32.slice/crio-b113a89202744ae38b461e3bc3e5e79b3e8bb3caed8c251f68e511f020591be8 WatchSource:0}: Error finding container b113a89202744ae38b461e3bc3e5e79b3e8bb3caed8c251f68e511f020591be8: Status 404 returned error can't find the container with id b113a89202744ae38b461e3bc3e5e79b3e8bb3caed8c251f68e511f020591be8 Jul 22 01:47:25.118714 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.118578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:25.118714 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.118652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:25.118906 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.118727 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:25.118906 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.118749 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:25.118906 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.118808 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:27.118786921 +0000 UTC m=+6.058754162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:25.118906 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.118824 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:47:27.118816735 +0000 UTC m=+6.058783975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:25.321058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.321010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:25.321889 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.321302 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:25.321889 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.321330 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:25.321889 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.321383 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:25.321889 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.321450 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:27.321430788 +0000 UTC m=+6.261398055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:25.536383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.536309 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:42:24 +0000 UTC" deadline="2028-05-03 14:52:44.393031516 +0000 UTC" Jul 22 01:47:25.536383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.536381 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15637h5m18.856655855s" Jul 22 01:47:25.562015 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.561978 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:25.562185 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.562129 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:25.562770 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.562517 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:25.562770 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:25.562644 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:25.588216 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.588178 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sxfpz" event={"ID":"87deed16-ac17-4ab0-bffe-c4072110040b","Type":"ContainerStarted","Data":"fcb3f483f32a540b58551ef0c78ae240e892696c956172410302da183063cadf"} Jul 22 01:47:25.598911 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.598854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" event={"ID":"004580757f306e7a3c43a8130fcf2570","Type":"ContainerStarted","Data":"e0de825edc0b3c6cd477a7afa21a54cf18af37e5f6b6c504172ecf3af4767e1b"} Jul 22 01:47:25.614993 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.614932 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" podStartSLOduration=2.6149124969999997 podStartE2EDuration="2.614912497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:25.614713219 +0000 UTC m=+4.554680485" watchObservedRunningTime="2026-07-22 01:47:25.614912497 +0000 UTC m=+4.554879767" Jul 22 01:47:25.619282 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.619167 2554 generic.go:356] "Generic (PLEG): container finished" podID="63877844a9a70797bbd7b58b4360d66f" containerID="3e3fd71715e6e0b64c848f101451549359d562ab2bffa8a1fac3e805644eab16" exitCode=0 Jul 22 01:47:25.619282 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.619253 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" event={"ID":"63877844a9a70797bbd7b58b4360d66f","Type":"ContainerDied","Data":"3e3fd71715e6e0b64c848f101451549359d562ab2bffa8a1fac3e805644eab16"} Jul 22 01:47:25.623447 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.623415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" event={"ID":"ef58141b-d9d5-431e-bfd8-9100198fcc32","Type":"ContainerStarted","Data":"b113a89202744ae38b461e3bc3e5e79b3e8bb3caed8c251f68e511f020591be8"} Jul 22 01:47:25.631376 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.631341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerStarted","Data":"b48d725174352cf334c075e5c060fa5ee077fdccc87d863415088dd4234ff42c"} Jul 22 01:47:25.648565 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.648525 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xdddc" event={"ID":"3547a4a3-ea1e-46d5-9993-ceb85f411e41","Type":"ContainerStarted","Data":"34b43dce7512141c6aa29b45b0218a27da826f72316280a401a025da29fdf77c"} Jul 22 01:47:25.658772 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.658740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"fbbbc698539e80f49643935be2470f13dafabe31eba5d34a03efc5e89af012b6"} Jul 22 01:47:25.664451 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.664420 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7nlt" event={"ID":"754f03ce-1f47-4f19-b188-e4f4c7f28d43","Type":"ContainerStarted","Data":"6b330a0091ccafb595e4cec3b12c1579f858feddff0dad8f4110233868999f9d"} Jul 22 01:47:25.689759 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.689723 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fxx9x" event={"ID":"aa8f0250-d592-456e-b0a8-26a7e9277844","Type":"ContainerStarted","Data":"43d8f5f27b8773d85ddffcbe107fa217535715ae03b3b7e1a15586642e17406f"} Jul 22 01:47:25.711456 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.711374 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xv99m" event={"ID":"2be73834-331a-439e-afe5-7cefab57fa42","Type":"ContainerStarted","Data":"bf37e7f116e2dcafb0ced70758361d9b2cf40b0ac0b96beef7b4260549868e1c"} Jul 22 01:47:25.732144 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:25.732013 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98ngj" event={"ID":"8cbabdd9-b920-4219-ba7e-0656628d05d8","Type":"ContainerStarted","Data":"dafada7ffb0e06c3a588a73e15f6a898fc0725a243fb34f0934d20237135f505"} Jul 22 01:47:26.559535 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:26.559499 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:26.560086 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:26.559664 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:26.756449 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:26.756408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" event={"ID":"63877844a9a70797bbd7b58b4360d66f","Type":"ContainerStarted","Data":"c4ae63db185dc8e5cc0e31c7dae7f3c75da1a845187d83d4b7c34c02d47b8af9"} Jul 22 01:47:26.772855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:26.772793 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" podStartSLOduration=3.772767599 podStartE2EDuration="3.772767599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:26.771619874 +0000 UTC m=+5.711587142" watchObservedRunningTime="2026-07-22 01:47:26.772767599 +0000 UTC m=+5.712734871" Jul 22 01:47:27.140748 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:27.140709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:27.140933 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:27.140778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:27.140933 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.140905 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:27.141062 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.140969 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:47:31.140949694 +0000 UTC m=+10.080916934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:27.141062 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.141046 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:27.141178 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.141083 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:31.141070862 +0000 UTC m=+10.081038108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:27.343162 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:27.343120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:27.343355 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.343334 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:27.343355 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.343356 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:27.343473 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.343369 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:27.343473 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.343433 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:31.343412693 +0000 UTC m=+10.283379953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:27.561106 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:27.561032 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:27.561624 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.561171 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:27.561624 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:27.561551 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:27.561738 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:27.561678 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:28.559380 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:28.559330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:28.559599 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:28.559496 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:29.560864 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:29.559725 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:29.560864 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:29.559754 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:29.560864 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:29.559878 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:29.560864 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:29.560000 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:30.558932 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:30.558855 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:30.559151 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:30.559014 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:31.178462 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:31.178424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:31.178939 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:31.178489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:31.178939 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.178625 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:31.178939 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.178683 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:47:39.178665265 +0000 UTC m=+18.118632504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:31.179122 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.179036 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:31.179122 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.179077 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:39.179065614 +0000 UTC m=+18.119032854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:31.380469 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:31.380433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:31.380695 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.380619 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:31.380695 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.380642 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:31.380695 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.380654 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:31.380867 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.380709 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:39.38069156 +0000 UTC m=+18.320658804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:31.560095 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:31.560009 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:31.560219 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.560134 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:31.560713 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:31.560548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:31.560713 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:31.560647 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:32.559520 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:32.559479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:32.559971 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:32.559626 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:33.561338 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:33.561305 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:33.561755 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:33.561407 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:33.561755 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:33.561649 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:33.561876 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:33.561778 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:34.558845 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:34.558809 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:34.559033 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:34.558943 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:35.559355 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:35.559322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:35.559847 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:35.559330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:35.559847 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:35.559440 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:35.559847 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:35.559579 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:36.558719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:36.558634 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:36.558857 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:36.558773 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:37.558791 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:37.558752 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:37.559228 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:37.558802 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:37.559228 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:37.558899 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:37.559228 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:37.559017 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:38.568698 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:38.568664 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:38.569133 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:38.568803 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:39.238581 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:39.238542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:39.238836 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:39.238608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:39.238836 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.238701 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:39.238836 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.238737 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:39.238836 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.238773 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:55.238752523 +0000 UTC m=+34.178719777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:39.238836 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.238795 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:47:55.238783798 +0000 UTC m=+34.178751037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:39.440615 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:39.440499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:39.440804 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.440663 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:39.440804 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.440689 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:39.440804 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.440701 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:39.440804 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.440760 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:55.440741303 +0000 UTC m=+34.380708548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:39.559052 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:39.558964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:39.559052 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:39.558998 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:39.559267 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.559116 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:39.559267 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:39.559223 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:40.558627 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:40.558594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:40.559014 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:40.558706 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:41.559203 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:41.559171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:41.559686 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:41.559303 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:41.559686 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:41.559370 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:41.559686 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:41.559483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:42.559456 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:42.559416 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:42.559892 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:42.559568 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:43.561934 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:43.561907 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:43.562365 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:43.562033 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:43.562365 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:43.562094 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:43.562365 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:43.562168 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:44.559528 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.559227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:44.559676 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:44.559592 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:44.800976 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.800952 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" event={"ID":"ef58141b-d9d5-431e-bfd8-9100198fcc32","Type":"ContainerStarted","Data":"b3fc1b67df84abba8a5649a9c4780819858e2ce7883ee53a02e6a35d51e1e638"} Jul 22 01:47:44.802471 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.802445 2554 generic.go:356] "Generic (PLEG): container finished" podID="badc808f-7fd9-4463-8d2a-cc1882c0981b" containerID="798b30584c6ef6c3d6f409c4b2901ea4af953d6b7fa770e2e2056d7c69de3258" exitCode=0 Jul 22 01:47:44.802596 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.802542 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerDied","Data":"798b30584c6ef6c3d6f409c4b2901ea4af953d6b7fa770e2e2056d7c69de3258"} Jul 22 01:47:44.803891 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.803870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xdddc" event={"ID":"3547a4a3-ea1e-46d5-9993-ceb85f411e41","Type":"ContainerStarted","Data":"2b424ada0b19e880c3f539cac42effdde70f7331189b752bb1932677a232882c"} Jul 22 01:47:44.806096 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.806078 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"04263ebc009a35d8f0811bc48305281239f5afc81b19dcc309bd88912c699768"} Jul 22 01:47:44.806172 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.806130 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"3eeb031d1b4faa535d1057c50d2e91b6447f3021408017ba0f1ca5804e88fc6e"} Jul 22 01:47:44.806226 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.806172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"2bb3552f1a84f66bcafee3afd9c4006f119cd4a3c1c4a09401f299693f20df0b"} Jul 22 01:47:44.806226 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.806205 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"b1b5da85fc63e53a866cfd9c757afafa83062b03849122a8fa72cd31e4ffa49f"} Jul 22 01:47:44.808015 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.807870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t7nlt" event={"ID":"754f03ce-1f47-4f19-b188-e4f4c7f28d43","Type":"ContainerStarted","Data":"27e74245d6989a13cdce0e4c00b98854a7f14ac17b3d1d7d1847b2006d9efb38"} Jul 22 01:47:44.811685 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.811666 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fxx9x" event={"ID":"aa8f0250-d592-456e-b0a8-26a7e9277844","Type":"ContainerStarted","Data":"6922d05bf2e0655e9683e4a7c1960cbe46f6430c691cd9cc86ebb44bb73a5e05"} Jul 22 01:47:44.812850 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.812831 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xv99m" event={"ID":"2be73834-331a-439e-afe5-7cefab57fa42","Type":"ContainerStarted","Data":"bd0a6b1b9799f5f11a289dd7fde245d7424c42ea842417df950ac12315baf387"} Jul 22 01:47:44.813997 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.813980 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98ngj" event={"ID":"8cbabdd9-b920-4219-ba7e-0656628d05d8","Type":"ContainerStarted","Data":"ddd5da23582d777fa220d70a19ae707ed7a58791db25a49ccf1a47ddf0447e9a"} Jul 22 01:47:44.836720 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.836679 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t7nlt" podStartSLOduration=3.327676339 podStartE2EDuration="22.836662476s" totalImagesPullingTime="19.508986137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:44.836561997 +0000 UTC m=+23.776529259" watchObservedRunningTime="2026-07-22 01:47:44.836662476 +0000 UTC m=+23.776629737" Jul 22 01:47:44.848817 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.848773 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-98ngj" podStartSLOduration=3.3150301349999998 podStartE2EDuration="22.848756217s" totalImagesPullingTime="19.533726082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:44.84854888 +0000 UTC m=+23.788516141" watchObservedRunningTime="2026-07-22 01:47:44.848756217 +0000 UTC m=+23.788723479" Jul 22 01:47:44.864085 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.864026 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xv99m" podStartSLOduration=3.277971423 podStartE2EDuration="22.864005108s" totalImagesPullingTime="19.586033685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:44.863265178 +0000 UTC m=+23.803232440" watchObservedRunningTime="2026-07-22 01:47:44.864005108 +0000 UTC m=+23.803972371" Jul 22 01:47:44.877845 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:44.877806 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fxx9x" podStartSLOduration=7.568457064 podStartE2EDuration="22.87779171s" totalImagesPullingTime="15.309334646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:44.877462806 +0000 UTC m=+23.817430063" watchObservedRunningTime="2026-07-22 01:47:44.87779171 +0000 UTC m=+23.817758971" Jul 22 01:47:45.562408 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.562376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:45.562408 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.562414 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:45.562741 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:45.562497 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:45.562741 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:45.562646 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:45.767095 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.767071 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 01:47:45.817973 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.817883 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" event={"ID":"ef58141b-d9d5-431e-bfd8-9100198fcc32","Type":"ContainerStarted","Data":"1ae4466c99dfcc21b2fc12536ca8dd7bf7d18b1495995a9d994ed9f4d8223b01"} Jul 22 01:47:45.821783 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.821735 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"a6cbda2bcfdedbebb2c8d74e3db57f79b12d0bd49c4141781b44cf0289d26d12"} Jul 22 01:47:45.821910 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.821816 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"cf6b7de844e887e0df1f611a3aad75659a447de9e06eb5bb1190d0fcac459da1"} Jul 22 01:47:45.823674 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.823648 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sxfpz" event={"ID":"87deed16-ac17-4ab0-bffe-c4072110040b","Type":"ContainerStarted","Data":"ac9eeaa0872fdef3bf0a99c59984f95939fe35d48f292c66b52d6d70b3410cdc"} Jul 22 01:47:45.838711 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.838655 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sxfpz" podStartSLOduration=4.297293988 podStartE2EDuration="23.838635176s" totalImagesPullingTime="19.541341188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:45.838244882 +0000 UTC m=+24.778212143" watchObservedRunningTime="2026-07-22 01:47:45.838635176 +0000 UTC m=+24.778602439" Jul 22 01:47:45.838872 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:45.838845 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xdddc" podStartSLOduration=4.283285081 podStartE2EDuration="23.838835223s" totalImagesPullingTime="19.555550142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:44.894090474 +0000 UTC m=+23.834057734" watchObservedRunningTime="2026-07-22 01:47:45.838835223 +0000 UTC m=+24.778802484" Jul 22 01:47:46.040814 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.040785 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:46.041604 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.041574 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:46.549738 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.549644 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T01:47:45.767090863Z","UUID":"5562cfe1-cbab-4de5-aa72-1a16a3a9c39c","Handler":null,"Name":"","Endpoint":""} Jul 22 01:47:46.551290 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.551268 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 01:47:46.551478 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.551310 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 01:47:46.558874 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.558845 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:46.558996 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:46.558969 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:46.826326 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.826237 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:46.827214 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:46.827186 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fxx9x" Jul 22 01:47:47.559042 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:47.558869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:47.559227 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:47.558927 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:47.559227 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:47.559117 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:47.559227 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:47.559203 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:47.831453 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:47.831355 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" event={"ID":"ef58141b-d9d5-431e-bfd8-9100198fcc32","Type":"ContainerStarted","Data":"e96ef0834edf8467970959371a2e1f0beef4c1f0bb551929b83468b02cb5dd9c"} Jul 22 01:47:47.835250 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:47.835222 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"4a67fca7285c447c3d3b215e64bc029862ff4e8bea6a6abf6449f2cac649d4cc"} Jul 22 01:47:47.852349 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:47.852297 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mm9s" podStartSLOduration=4.087090955 podStartE2EDuration="25.852280769s" totalImagesPullingTime="21.765189814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:47.850746655 +0000 UTC m=+26.790713916" watchObservedRunningTime="2026-07-22 01:47:47.852280769 +0000 UTC m=+26.792248081" Jul 22 01:47:48.559151 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:48.559116 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:48.559321 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:48.559231 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:49.559590 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.559405 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:49.560304 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.559491 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:49.560304 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:49.559669 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:49.560304 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:49.559786 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:49.842221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.842188 2554 generic.go:356] "Generic (PLEG): container finished" podID="badc808f-7fd9-4463-8d2a-cc1882c0981b" containerID="38e2e9de46d69df1f426f607122ab52293f06c016e72913f028485f70f2341cd" exitCode=0 Jul 22 01:47:49.842581 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.842265 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerDied","Data":"38e2e9de46d69df1f426f607122ab52293f06c016e72913f028485f70f2341cd"} Jul 22 01:47:49.846151 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.846128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" event={"ID":"1f491b8d-15e9-40dc-870b-157296ca3b0a","Type":"ContainerStarted","Data":"3a32ad0d75b14b5a72acea019d66a32a1113b9f974f1ccd4aefcc18e1f3c4e44"} Jul 22 01:47:49.846407 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.846390 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:49.861727 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.861699 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:49.892056 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:49.892009 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" podStartSLOduration=8.308142539 podStartE2EDuration="27.891994263s" totalImagesPullingTime="19.583851724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:47:49.890698622 +0000 UTC m=+28.830665884" watchObservedRunningTime="2026-07-22 01:47:49.891994263 +0000 UTC m=+28.831961523" Jul 22 01:47:50.559567 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:50.559537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:50.559913 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:50.559651 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:50.848550 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:50.848466 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:50.848775 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:50.848584 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:50.864635 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:50.864607 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:47:51.222337 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.222308 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9p4g6"] Jul 22 01:47:51.222658 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.222444 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:51.222658 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:51.222544 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:51.225327 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.225306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4zgdb"] Jul 22 01:47:51.225469 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.225456 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:51.225640 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:51.225618 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:51.226278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.226259 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8cvrx"] Jul 22 01:47:51.226352 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.226327 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:51.226397 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:51.226382 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:51.852103 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.852069 2554 generic.go:356] "Generic (PLEG): container finished" podID="badc808f-7fd9-4463-8d2a-cc1882c0981b" containerID="ac99db27bfc7a6abad0b7742206005562d59c751f9af2514b135d985660e954f" exitCode=0 Jul 22 01:47:51.852627 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:51.852160 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerDied","Data":"ac99db27bfc7a6abad0b7742206005562d59c751f9af2514b135d985660e954f"} Jul 22 01:47:52.559304 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:52.559272 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:52.559304 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:52.559288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:52.559500 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:52.559378 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:52.559565 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:52.559523 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:53.558852 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:53.558761 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:53.559182 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:53.558871 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:53.858616 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:53.858587 2554 generic.go:356] "Generic (PLEG): container finished" podID="badc808f-7fd9-4463-8d2a-cc1882c0981b" containerID="4821090f16bffbee2d483ec36d1fd75cac208b2381945b504bc855d174bc32bd" exitCode=0 Jul 22 01:47:53.858783 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:53.858624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerDied","Data":"4821090f16bffbee2d483ec36d1fd75cac208b2381945b504bc855d174bc32bd"} Jul 22 01:47:54.558636 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:54.558601 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:54.558854 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:54.558640 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:54.558854 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:54.558745 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:54.559244 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:54.558877 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:55.257679 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:55.257635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:55.257863 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:55.257720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:55.257863 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.257805 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:55.257863 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.257811 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:55.258023 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.257871 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs podName:15fa3782-0966-4522-a79f-79917f4dfd4c nodeName:}" failed. No retries permitted until 2026-07-22 01:48:27.25785378 +0000 UTC m=+66.197821033 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs") pod "network-metrics-daemon-4zgdb" (UID: "15fa3782-0966-4522-a79f-79917f4dfd4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 01:47:55.258023 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.257891 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret podName:3a104096-a728-4057-b64c-19adf6c03586 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:27.257882096 +0000 UTC m=+66.197849336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret") pod "global-pull-secret-syncer-9p4g6" (UID: "3a104096-a728-4057-b64c-19adf6c03586") : object "kube-system"/"original-pull-secret" not registered Jul 22 01:47:55.459162 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:55.459132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:55.459362 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.459342 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 01:47:55.459428 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.459369 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 01:47:55.459428 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.459383 2554 projected.go:196] Error preparing data for projected volume kube-api-access-j2m82 for pod openshift-network-diagnostics/network-check-target-8cvrx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:55.459523 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.459455 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82 podName:38510339-6bae-4aae-b39b-6d5fe73647a3 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:27.459436121 +0000 UTC m=+66.399403373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2m82" (UniqueName: "kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82") pod "network-check-target-8cvrx" (UID: "38510339-6bae-4aae-b39b-6d5fe73647a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 01:47:55.559098 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:55.559058 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:55.559575 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:55.559192 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cvrx" podUID="38510339-6bae-4aae-b39b-6d5fe73647a3" Jul 22 01:47:56.558860 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.558823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:56.559037 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.558862 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:56.559037 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:56.558954 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zgdb" podUID="15fa3782-0966-4522-a79f-79917f4dfd4c" Jul 22 01:47:56.559133 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:56.559092 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p4g6" podUID="3a104096-a728-4057-b64c-19adf6c03586" Jul 22 01:47:56.894609 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.894534 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeReady" Jul 22 01:47:56.894772 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.894691 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 01:47:56.933281 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.933246 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d6676fdbc-9n5qj"] Jul 22 01:47:56.955030 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.955002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:56.957775 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.957733 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qvcvb"] Jul 22 01:47:56.957918 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.957826 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 01:47:56.958051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.958033 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 01:47:56.958267 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.958144 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 01:47:56.958390 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.958330 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c2smp\"" Jul 22 01:47:56.964333 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.964121 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 01:47:56.978863 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.978826 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d6676fdbc-9n5qj"] Jul 22 01:47:56.979008 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.978873 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lv5wf"] Jul 22 01:47:56.979008 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.978953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:56.984481 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.984460 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqgw\"" Jul 22 01:47:56.985246 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.985222 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 01:47:56.986421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:56.986220 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 01:47:57.003351 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.003145 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvcvb"] Jul 22 01:47:57.003351 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.003185 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lv5wf"] Jul 22 01:47:57.003351 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.003268 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.006252 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.006187 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 01:47:57.006419 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.006401 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 01:47:57.006495 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.006401 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 01:47:57.006728 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.006706 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v5h9n\"" Jul 22 01:47:57.071995 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.071969 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-tmp-dir\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.072142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvltc\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-kube-api-access-nvltc\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-config-volume\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.072142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-installation-pull-secrets\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dq4b\" (UniqueName: \"kubernetes.io/projected/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-kube-api-access-9dq4b\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.072345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-certificates\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-trusted-ca\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-bound-sa-token\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072318 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-image-registry-private-configuration\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.072345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.072666 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.072378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-ca-trust-extracted\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173055 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-installation-pull-secrets\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173248 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dq4b\" (UniqueName: \"kubernetes.io/projected/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-kube-api-access-9dq4b\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.173248 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-certificates\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173248 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173248 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173185 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-trusted-ca\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173248 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-bound-sa-token\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173258 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gcl\" (UniqueName: \"kubernetes.io/projected/4f222ec5-bcc6-404f-8400-1804dacd9332-kube-api-access-26gcl\") pod \"ingress-canary-lv5wf\" (UID: \"4f222ec5-bcc6-404f-8400-1804dacd9332\") " pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.173473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-image-registry-private-configuration\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.173473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173368 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f222ec5-bcc6-404f-8400-1804dacd9332-cert\") pod \"ingress-canary-lv5wf\" (UID: \"4f222ec5-bcc6-404f-8400-1804dacd9332\") " pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.173473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-ca-trust-extracted\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-tmp-dir\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.173763 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvltc\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-kube-api-access-nvltc\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.173763 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.173552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-config-volume\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.174251 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.174226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-config-volume\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.175459 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.175431 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-certificates\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.175610 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.175582 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:47:57.175610 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.175598 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6676fdbc-9n5qj: secret "image-registry-tls" not found Jul 22 01:47:57.175739 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.175720 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls podName:fde02c6b-c800-4a8c-bb96-7cb3dfc40224 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:57.675679613 +0000 UTC m=+36.615646865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls") pod "image-registry-7d6676fdbc-9n5qj" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224") : secret "image-registry-tls" not found Jul 22 01:47:57.175981 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.175958 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-ca-trust-extracted\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.176207 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.176182 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:47:57.176289 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.176282 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls podName:ca86d95e-a805-450d-97f8-d4d7d3cfe66f nodeName:}" failed. No retries permitted until 2026-07-22 01:47:57.676262518 +0000 UTC m=+36.616229769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls") pod "dns-default-qvcvb" (UID: "ca86d95e-a805-450d-97f8-d4d7d3cfe66f") : secret "dns-default-metrics-tls" not found Jul 22 01:47:57.176596 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.176529 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-tmp-dir\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.177528 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.177484 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:47:57.177980 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.177958 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-trusted-ca\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.179730 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.179705 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-installation-pull-secrets\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.179824 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.179726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-image-registry-private-configuration\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.183859 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.183837 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dq4b\" (UniqueName: \"kubernetes.io/projected/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-kube-api-access-9dq4b\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.185470 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.185450 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-bound-sa-token\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.185742 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.185720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvltc\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-kube-api-access-nvltc\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.274167 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.274134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gcl\" (UniqueName: \"kubernetes.io/projected/4f222ec5-bcc6-404f-8400-1804dacd9332-kube-api-access-26gcl\") pod \"ingress-canary-lv5wf\" (UID: \"4f222ec5-bcc6-404f-8400-1804dacd9332\") " pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.274349 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.274201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f222ec5-bcc6-404f-8400-1804dacd9332-cert\") pod \"ingress-canary-lv5wf\" (UID: \"4f222ec5-bcc6-404f-8400-1804dacd9332\") " pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.277085 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.277062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f222ec5-bcc6-404f-8400-1804dacd9332-cert\") pod \"ingress-canary-lv5wf\" (UID: \"4f222ec5-bcc6-404f-8400-1804dacd9332\") " pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.279405 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.279381 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:47:57.283535 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.283493 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gcl\" (UniqueName: \"kubernetes.io/projected/4f222ec5-bcc6-404f-8400-1804dacd9332-kube-api-access-26gcl\") pod \"ingress-canary-lv5wf\" (UID: \"4f222ec5-bcc6-404f-8400-1804dacd9332\") " pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.314109 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.314074 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lv5wf" Jul 22 01:47:57.559037 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.558949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:47:57.563246 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.563223 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 01:47:57.563974 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.563301 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6r65\"" Jul 22 01:47:57.563974 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.563224 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 01:47:57.677881 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.677849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:57.678050 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:57.677901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:57.678050 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.678046 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:47:57.678170 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.678108 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls podName:ca86d95e-a805-450d-97f8-d4d7d3cfe66f nodeName:}" failed. No retries permitted until 2026-07-22 01:47:58.678089302 +0000 UTC m=+37.618056559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls") pod "dns-default-qvcvb" (UID: "ca86d95e-a805-450d-97f8-d4d7d3cfe66f") : secret "dns-default-metrics-tls" not found Jul 22 01:47:57.678529 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.678489 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:47:57.678529 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.678525 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6676fdbc-9n5qj: secret "image-registry-tls" not found Jul 22 01:47:57.678664 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:57.678568 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls podName:fde02c6b-c800-4a8c-bb96-7cb3dfc40224 nodeName:}" failed. No retries permitted until 2026-07-22 01:47:58.678554364 +0000 UTC m=+37.618521606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls") pod "image-registry-7d6676fdbc-9n5qj" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224") : secret "image-registry-tls" not found Jul 22 01:47:58.192318 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.192158 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lv5wf"] Jul 22 01:47:58.214986 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:47:58.214956 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f222ec5_bcc6_404f_8400_1804dacd9332.slice/crio-181651a48702a40963241f2dfad7748775e5170e51f314fc275372d209a0e3cc WatchSource:0}: Error finding container 181651a48702a40963241f2dfad7748775e5170e51f314fc275372d209a0e3cc: Status 404 returned error can't find the container with id 181651a48702a40963241f2dfad7748775e5170e51f314fc275372d209a0e3cc Jul 22 01:47:58.558843 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.558761 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:47:58.558978 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.558934 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:47:58.562637 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.562616 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:47:58.563008 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.562993 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:47:58.563061 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.562993 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rnbhf\"" Jul 22 01:47:58.686429 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.686390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:47:58.686893 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.686442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:47:58.686893 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:58.686572 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:47:58.686893 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:58.686573 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:47:58.686893 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:58.686600 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6676fdbc-9n5qj: secret "image-registry-tls" not found Jul 22 01:47:58.686893 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:58.686635 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls podName:ca86d95e-a805-450d-97f8-d4d7d3cfe66f nodeName:}" failed. No retries permitted until 2026-07-22 01:48:00.686618052 +0000 UTC m=+39.626585291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls") pod "dns-default-qvcvb" (UID: "ca86d95e-a805-450d-97f8-d4d7d3cfe66f") : secret "dns-default-metrics-tls" not found Jul 22 01:47:58.686893 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:47:58.686654 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls podName:fde02c6b-c800-4a8c-bb96-7cb3dfc40224 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:00.686645671 +0000 UTC m=+39.626613094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls") pod "image-registry-7d6676fdbc-9n5qj" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224") : secret "image-registry-tls" not found Jul 22 01:47:58.871564 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.871457 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lv5wf" event={"ID":"4f222ec5-bcc6-404f-8400-1804dacd9332","Type":"ContainerStarted","Data":"181651a48702a40963241f2dfad7748775e5170e51f314fc275372d209a0e3cc"} Jul 22 01:47:58.874492 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.874462 2554 generic.go:356] "Generic (PLEG): container finished" podID="badc808f-7fd9-4463-8d2a-cc1882c0981b" containerID="eac2479d144c705cc902562479581171dc84fcd5814c71f3024c5789ea714b6e" exitCode=0 Jul 22 01:47:58.874621 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:58.874527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerDied","Data":"eac2479d144c705cc902562479581171dc84fcd5814c71f3024c5789ea714b6e"} Jul 22 01:47:59.880926 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:59.880803 2554 generic.go:356] "Generic (PLEG): container finished" podID="badc808f-7fd9-4463-8d2a-cc1882c0981b" containerID="fd0ba7c44d48fe7865990b7c80c11065904b118208a0dd021ee1f5ef32068637" exitCode=0 Jul 22 01:47:59.880926 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:47:59.880870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerDied","Data":"fd0ba7c44d48fe7865990b7c80c11065904b118208a0dd021ee1f5ef32068637"} Jul 22 01:48:00.705926 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:00.705772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:00.706103 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:00.705924 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:48:00.706103 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:00.705944 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6676fdbc-9n5qj: secret "image-registry-tls" not found Jul 22 01:48:00.706103 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:00.705946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:00.706103 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:00.705994 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls podName:fde02c6b-c800-4a8c-bb96-7cb3dfc40224 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:04.705977967 +0000 UTC m=+43.645945210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls") pod "image-registry-7d6676fdbc-9n5qj" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224") : secret "image-registry-tls" not found Jul 22 01:48:00.706103 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:00.706033 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:48:00.706103 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:00.706076 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls podName:ca86d95e-a805-450d-97f8-d4d7d3cfe66f nodeName:}" failed. No retries permitted until 2026-07-22 01:48:04.706062363 +0000 UTC m=+43.646029602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls") pod "dns-default-qvcvb" (UID: "ca86d95e-a805-450d-97f8-d4d7d3cfe66f") : secret "dns-default-metrics-tls" not found Jul 22 01:48:00.886951 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:00.886920 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" event={"ID":"badc808f-7fd9-4463-8d2a-cc1882c0981b","Type":"ContainerStarted","Data":"18b6c31f0afd0b46406bbb884bad74f5b030234db5bcf049cf218b4fdc45e4a2"} Jul 22 01:48:00.888298 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:00.888277 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lv5wf" event={"ID":"4f222ec5-bcc6-404f-8400-1804dacd9332","Type":"ContainerStarted","Data":"bb12143cae8ceb607ffea21f3ff3df9146b06f4f2afb2823fb858f2f2309b22b"} Jul 22 01:48:00.913170 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:00.913129 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z8gbf" podStartSLOduration=7.965688806 podStartE2EDuration="38.913117675s" totalImagesPullingTime="30.947428869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:00.912426921 +0000 UTC m=+39.852394182" watchObservedRunningTime="2026-07-22 01:48:00.913117675 +0000 UTC m=+39.853084936" Jul 22 01:48:01.071491 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.071449 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:01.171149 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.171123 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:01.297656 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.297576 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:01.363572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.363545 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:01.583917 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.583809 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lv5wf" podStartSLOduration=3.362065496 podStartE2EDuration="5.583787748s" totalImagesPullingTime="2.221722252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:00.952028922 +0000 UTC m=+39.891996182" watchObservedRunningTime="2026-07-22 01:48:01.583787748 +0000 UTC m=+40.523755010" Jul 22 01:48:01.584775 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.584755 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk"] Jul 22 01:48:01.586927 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.586910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" Jul 22 01:48:01.589338 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.589306 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.589499 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.589343 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m4w4w\"" Jul 22 01:48:01.590283 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.590262 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.591435 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.591415 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc"] Jul 22 01:48:01.593395 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.593376 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg"] Jul 22 01:48:01.593537 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.593520 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.595691 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.595673 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 01:48:01.596645 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.596624 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 01:48:01.596749 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.596652 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l2n7z\"" Jul 22 01:48:01.596749 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.596624 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.597756 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.597729 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.600256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.600233 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk"] Jul 22 01:48:01.600374 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.600357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:01.605058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.605036 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.605169 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.605100 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 01:48:01.605169 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.605133 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ddwzd\"" Jul 22 01:48:01.606447 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.606424 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.607627 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.607603 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc"] Jul 22 01:48:01.632720 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.632020 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg"] Jul 22 01:48:01.688118 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.688087 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-q5h5g"] Jul 22 01:48:01.690158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.690141 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.691916 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.691889 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-zq9wq"] Jul 22 01:48:01.692477 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.692456 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 01:48:01.692612 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.692557 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 01:48:01.692851 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.692831 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4vgbd\"" Jul 22 01:48:01.693049 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.693036 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.694004 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.693989 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6"] Jul 22 01:48:01.694117 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.694103 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.696063 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.696047 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58fd7458cb-mzkb2"] Jul 22 01:48:01.696178 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.696165 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.696455 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.696433 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.696558 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.696540 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 01:48:01.696558 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.696549 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 01:48:01.696904 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.696885 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p4lbk\"" Jul 22 01:48:01.697049 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.697033 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.698268 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.698232 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.698369 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.698265 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pj7pn\"" Jul 22 01:48:01.698369 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.698344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 01:48:01.698481 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.698401 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.699084 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.699067 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.699391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.699358 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 01:48:01.699671 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.699654 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 01:48:01.700985 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.700963 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.703238 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.703216 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 01:48:01.703707 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.703690 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 01:48:01.704291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.703835 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wtr6n\"" Jul 22 01:48:01.704291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.703847 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.704291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.703863 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 01:48:01.704291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.703810 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 01:48:01.704291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.704012 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.704291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.704150 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 01:48:01.704750 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.704580 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-q5h5g"] Jul 22 01:48:01.706239 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.706077 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6"] Jul 22 01:48:01.708369 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.708347 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-zq9wq"] Jul 22 01:48:01.708466 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.708392 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58fd7458cb-mzkb2"] Jul 22 01:48:01.727732 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.727695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-stats-auth\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.727832 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.727768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xfjj\" (UniqueName: \"kubernetes.io/projected/0893a9f4-2552-4b8e-af5a-2e43e0a24618-kube-api-access-6xfjj\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.727903 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.727825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mb75\" (UniqueName: \"kubernetes.io/projected/6332509e-066d-40fb-afc4-0eaec4e38234-kube-api-access-9mb75\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.727961 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.727888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cfcb9752-c785-43e1-ba5d-6328fd02dec9-snapshots\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.728397 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728357 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmwj\" (UniqueName: \"kubernetes.io/projected/37952390-fa46-4a89-a529-cf9451d4b668-kube-api-access-gkmwj\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.728491 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dszmx\" (UniqueName: \"kubernetes.io/projected/7da6a476-31c8-4603-beca-87308caf7237-kube-api-access-dszmx\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:01.728555 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxb6\" (UniqueName: \"kubernetes.io/projected/06c8ad63-a743-4e4f-beaf-68f6f46d2138-kube-api-access-9sxb6\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.728599 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfcb9752-c785-43e1-ba5d-6328fd02dec9-tmp\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.728635 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37952390-fa46-4a89-a529-cf9451d4b668-trusted-ca\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.728734 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-default-certificate\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.728791 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.728841 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.728823 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.729023 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37952390-fa46-4a89-a529-cf9451d4b668-serving-cert\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.729082 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729041 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.729128 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729085 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:01.729128 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6332509e-066d-40fb-afc4-0eaec4e38234-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.729213 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729137 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6332509e-066d-40fb-afc4-0eaec4e38234-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.729213 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/06c8ad63-a743-4e4f-beaf-68f6f46d2138-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.729213 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729200 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37952390-fa46-4a89-a529-cf9451d4b668-config\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.729341 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.729236 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrs5\" (UniqueName: \"kubernetes.io/projected/8627ee41-9af2-4187-a91e-e853df0aafd2-kube-api-access-xsrs5\") pod \"volume-data-source-validator-78cf4c6f6-hdkwk\" (UID: \"8627ee41-9af2-4187-a91e-e853df0aafd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" Jul 22 01:48:01.786037 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.786010 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq"] Jul 22 01:48:01.788566 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.788545 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" Jul 22 01:48:01.789049 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.789029 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4"] Jul 22 01:48:01.790462 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.790445 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lpjqk\"" Jul 22 01:48:01.791235 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.791217 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.793111 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.793094 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 01:48:01.793214 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.793200 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dtjv4\"" Jul 22 01:48:01.793444 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.793415 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:48:01.793580 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.793455 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 01:48:01.793580 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.793568 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 01:48:01.798345 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.798324 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq"] Jul 22 01:48:01.802828 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.802809 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4"] Jul 22 01:48:01.830280 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psmhk\" (UniqueName: \"kubernetes.io/projected/3110a53c-0213-4a22-aa0e-65395432fd74-kube-api-access-psmhk\") pod \"network-check-source-7bc5b6bf85-lbmgq\" (UID: \"3110a53c-0213-4a22-aa0e-65395432fd74\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" Jul 22 01:48:01.830391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830289 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xfjj\" (UniqueName: \"kubernetes.io/projected/0893a9f4-2552-4b8e-af5a-2e43e0a24618-kube-api-access-6xfjj\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.830391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mb75\" (UniqueName: \"kubernetes.io/projected/6332509e-066d-40fb-afc4-0eaec4e38234-kube-api-access-9mb75\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.830391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cfcb9752-c785-43e1-ba5d-6328fd02dec9-snapshots\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.830391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmwj\" (UniqueName: \"kubernetes.io/projected/37952390-fa46-4a89-a529-cf9451d4b668-kube-api-access-gkmwj\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.830391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dszmx\" (UniqueName: \"kubernetes.io/projected/7da6a476-31c8-4603-beca-87308caf7237-kube-api-access-dszmx\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxb6\" (UniqueName: \"kubernetes.io/projected/06c8ad63-a743-4e4f-beaf-68f6f46d2138-kube-api-access-9sxb6\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfcb9752-c785-43e1-ba5d-6328fd02dec9-tmp\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37952390-fa46-4a89-a529-cf9451d4b668-trusted-ca\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfcb9752-c785-43e1-ba5d-6328fd02dec9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfcb9752-c785-43e1-ba5d-6328fd02dec9-service-ca-bundle\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830558 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9rjl\" (UniqueName: \"kubernetes.io/projected/7ea652f8-82c2-498d-b6d0-e51379f5589b-kube-api-access-m9rjl\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.830638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830614 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea652f8-82c2-498d-b6d0-e51379f5589b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-default-certificate\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37952390-fa46-4a89-a529-cf9451d4b668-serving-cert\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.830820 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6332509e-066d-40fb-afc4-0eaec4e38234-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.830851 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.830865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6332509e-066d-40fb-afc4-0eaec4e38234-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.830942 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.830912 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:02.330873091 +0000 UTC m=+41.270840334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : secret "router-metrics-certs-default" not found Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.830968 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls podName:06c8ad63-a743-4e4f-beaf-68f6f46d2138 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:02.330953888 +0000 UTC m=+41.270921132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2jqm6" (UID: "06c8ad63-a743-4e4f-beaf-68f6f46d2138") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.830987 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:02.330978351 +0000 UTC m=+41.270945612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : configmap references non-existent config key: service-ca.crt Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ea652f8-82c2-498d-b6d0-e51379f5589b-config\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831036 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cfcb9752-c785-43e1-ba5d-6328fd02dec9-snapshots\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcv97\" (UniqueName: \"kubernetes.io/projected/cfcb9752-c785-43e1-ba5d-6328fd02dec9-kube-api-access-vcv97\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/06c8ad63-a743-4e4f-beaf-68f6f46d2138-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.831071 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37952390-fa46-4a89-a529-cf9451d4b668-config\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfcb9752-c785-43e1-ba5d-6328fd02dec9-serving-cert\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrs5\" (UniqueName: \"kubernetes.io/projected/8627ee41-9af2-4187-a91e-e853df0aafd2-kube-api-access-xsrs5\") pod \"volume-data-source-validator-78cf4c6f6-hdkwk\" (UID: \"8627ee41-9af2-4187-a91e-e853df0aafd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-stats-auth\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831369 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6332509e-066d-40fb-afc4-0eaec4e38234-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.831488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831486 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfcb9752-c785-43e1-ba5d-6328fd02dec9-tmp\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.832087 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.831625 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37952390-fa46-4a89-a529-cf9451d4b668-trusted-ca\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.832087 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:01.831674 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls podName:7da6a476-31c8-4603-beca-87308caf7237 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:02.331655811 +0000 UTC m=+41.271623051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-m88qg" (UID: "7da6a476-31c8-4603-beca-87308caf7237") : secret "samples-operator-tls" not found Jul 22 01:48:01.832087 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.832070 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/06c8ad63-a743-4e4f-beaf-68f6f46d2138-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.832217 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.832073 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37952390-fa46-4a89-a529-cf9451d4b668-config\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.834995 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.834937 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6332509e-066d-40fb-afc4-0eaec4e38234-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.835073 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.835046 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37952390-fa46-4a89-a529-cf9451d4b668-serving-cert\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.835142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.835126 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-default-certificate\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.835177 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.835127 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-stats-auth\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.839201 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.839171 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xfjj\" (UniqueName: \"kubernetes.io/projected/0893a9f4-2552-4b8e-af5a-2e43e0a24618-kube-api-access-6xfjj\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:01.839456 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.839430 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mb75\" (UniqueName: \"kubernetes.io/projected/6332509e-066d-40fb-afc4-0eaec4e38234-kube-api-access-9mb75\") pod \"kube-storage-version-migrator-operator-7658d9b749-rcksc\" (UID: \"6332509e-066d-40fb-afc4-0eaec4e38234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.839645 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.839623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dszmx\" (UniqueName: \"kubernetes.io/projected/7da6a476-31c8-4603-beca-87308caf7237-kube-api-access-dszmx\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:01.839702 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.839644 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxb6\" (UniqueName: \"kubernetes.io/projected/06c8ad63-a743-4e4f-beaf-68f6f46d2138-kube-api-access-9sxb6\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:01.839778 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.839762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrs5\" (UniqueName: \"kubernetes.io/projected/8627ee41-9af2-4187-a91e-e853df0aafd2-kube-api-access-xsrs5\") pod \"volume-data-source-validator-78cf4c6f6-hdkwk\" (UID: \"8627ee41-9af2-4187-a91e-e853df0aafd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" Jul 22 01:48:01.840042 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.840027 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmwj\" (UniqueName: \"kubernetes.io/projected/37952390-fa46-4a89-a529-cf9451d4b668-kube-api-access-gkmwj\") pod \"console-operator-565b7b569d-zq9wq\" (UID: \"37952390-fa46-4a89-a529-cf9451d4b668\") " pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:01.843537 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.843495 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:01.897986 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.897957 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" Jul 22 01:48:01.925617 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.925588 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" Jul 22 01:48:01.931652 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.931625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfcb9752-c785-43e1-ba5d-6328fd02dec9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.931776 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.931662 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfcb9752-c785-43e1-ba5d-6328fd02dec9-service-ca-bundle\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.931776 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.931693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9rjl\" (UniqueName: \"kubernetes.io/projected/7ea652f8-82c2-498d-b6d0-e51379f5589b-kube-api-access-m9rjl\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.931890 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.931776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea652f8-82c2-498d-b6d0-e51379f5589b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.931946 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.931913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ea652f8-82c2-498d-b6d0-e51379f5589b-config\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.931995 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.931966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcv97\" (UniqueName: \"kubernetes.io/projected/cfcb9752-c785-43e1-ba5d-6328fd02dec9-kube-api-access-vcv97\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.932058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.932021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfcb9752-c785-43e1-ba5d-6328fd02dec9-serving-cert\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.932138 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.932122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psmhk\" (UniqueName: \"kubernetes.io/projected/3110a53c-0213-4a22-aa0e-65395432fd74-kube-api-access-psmhk\") pod \"network-check-source-7bc5b6bf85-lbmgq\" (UID: \"3110a53c-0213-4a22-aa0e-65395432fd74\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" Jul 22 01:48:01.932935 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.932550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ea652f8-82c2-498d-b6d0-e51379f5589b-config\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.932935 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.932698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfcb9752-c785-43e1-ba5d-6328fd02dec9-service-ca-bundle\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.932935 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.932884 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfcb9752-c785-43e1-ba5d-6328fd02dec9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.934723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.934699 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea652f8-82c2-498d-b6d0-e51379f5589b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.935292 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.935271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfcb9752-c785-43e1-ba5d-6328fd02dec9-serving-cert\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.940568 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.940537 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9rjl\" (UniqueName: \"kubernetes.io/projected/7ea652f8-82c2-498d-b6d0-e51379f5589b-kube-api-access-m9rjl\") pod \"service-ca-operator-5bcbc94c78-vl6n4\" (UID: \"7ea652f8-82c2-498d-b6d0-e51379f5589b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:01.940948 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.940923 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psmhk\" (UniqueName: \"kubernetes.io/projected/3110a53c-0213-4a22-aa0e-65395432fd74-kube-api-access-psmhk\") pod \"network-check-source-7bc5b6bf85-lbmgq\" (UID: \"3110a53c-0213-4a22-aa0e-65395432fd74\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" Jul 22 01:48:01.941919 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.941886 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcv97\" (UniqueName: \"kubernetes.io/projected/cfcb9752-c785-43e1-ba5d-6328fd02dec9-kube-api-access-vcv97\") pod \"insights-operator-555d9d7885-q5h5g\" (UID: \"cfcb9752-c785-43e1-ba5d-6328fd02dec9\") " pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:01.943971 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:01.943928 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:02.003179 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.002919 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" Jul 22 01:48:02.010820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.010780 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:02.032811 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.032785 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk"] Jul 22 01:48:02.037486 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:02.037452 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8627ee41_9af2_4187_a91e_e853df0aafd2.slice/crio-c48ea1aa57f8f8bb2b0a92630a9b2bfc004d64f35ad59797f6f276083c71d388 WatchSource:0}: Error finding container c48ea1aa57f8f8bb2b0a92630a9b2bfc004d64f35ad59797f6f276083c71d388: Status 404 returned error can't find the container with id c48ea1aa57f8f8bb2b0a92630a9b2bfc004d64f35ad59797f6f276083c71d388 Jul 22 01:48:02.065180 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.065109 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc"] Jul 22 01:48:02.072719 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:02.072683 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6332509e_066d_40fb_afc4_0eaec4e38234.slice/crio-52c73b81cbb6ec5b749e759982ae9c3a2a81f63709013a488e99767a0c10fc72 WatchSource:0}: Error finding container 52c73b81cbb6ec5b749e759982ae9c3a2a81f63709013a488e99767a0c10fc72: Status 404 returned error can't find the container with id 52c73b81cbb6ec5b749e759982ae9c3a2a81f63709013a488e99767a0c10fc72 Jul 22 01:48:02.097817 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.097794 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" Jul 22 01:48:02.103660 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.103636 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" Jul 22 01:48:02.148244 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.146566 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-q5h5g"] Jul 22 01:48:02.149790 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:02.149763 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfcb9752_c785_43e1_ba5d_6328fd02dec9.slice/crio-5e5ef3327a07a9fae194795d8f3f98fbc1eb69f4ba228d4e5baee6dc5ccac0b3 WatchSource:0}: Error finding container 5e5ef3327a07a9fae194795d8f3f98fbc1eb69f4ba228d4e5baee6dc5ccac0b3: Status 404 returned error can't find the container with id 5e5ef3327a07a9fae194795d8f3f98fbc1eb69f4ba228d4e5baee6dc5ccac0b3 Jul 22 01:48:02.166489 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.166459 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-zq9wq"] Jul 22 01:48:02.239135 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.239105 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq"] Jul 22 01:48:02.241993 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:02.241969 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3110a53c_0213_4a22_aa0e_65395432fd74.slice/crio-71874fbc118f3d29aef77bad80ec2b3181c4bcceacda94d7cd68750d8b94353c WatchSource:0}: Error finding container 71874fbc118f3d29aef77bad80ec2b3181c4bcceacda94d7cd68750d8b94353c: Status 404 returned error can't find the container with id 71874fbc118f3d29aef77bad80ec2b3181c4bcceacda94d7cd68750d8b94353c Jul 22 01:48:02.253805 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.253780 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4"] Jul 22 01:48:02.257703 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:02.257675 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea652f8_82c2_498d_b6d0_e51379f5589b.slice/crio-37fd58c2b7f03220d43ced8cea02d5253e64201a754c142d42f1a7c8a7ccdeca WatchSource:0}: Error finding container 37fd58c2b7f03220d43ced8cea02d5253e64201a754c142d42f1a7c8a7ccdeca: Status 404 returned error can't find the container with id 37fd58c2b7f03220d43ced8cea02d5253e64201a754c142d42f1a7c8a7ccdeca Jul 22 01:48:02.335974 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.335944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:02.335974 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.335979 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:02.336184 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.336025 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:02.336184 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.336098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:02.336184 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336104 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:02.336306 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336195 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:03.336176277 +0000 UTC m=+42.276143538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : configmap references non-existent config key: service-ca.crt Jul 22 01:48:02.336306 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336104 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:48:02.336306 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336146 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:48:02.336306 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336284 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls podName:06c8ad63-a743-4e4f-beaf-68f6f46d2138 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:03.336259552 +0000 UTC m=+42.276226806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2jqm6" (UID: "06c8ad63-a743-4e4f-beaf-68f6f46d2138") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:02.336496 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336324 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:03.336312175 +0000 UTC m=+42.276279417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : secret "router-metrics-certs-default" not found Jul 22 01:48:02.336496 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:02.336347 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls podName:7da6a476-31c8-4603-beca-87308caf7237 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:03.33633861 +0000 UTC m=+42.276305882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-m88qg" (UID: "7da6a476-31c8-4603-beca-87308caf7237") : secret "samples-operator-tls" not found Jul 22 01:48:02.898318 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.898282 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" event={"ID":"3110a53c-0213-4a22-aa0e-65395432fd74","Type":"ContainerStarted","Data":"71874fbc118f3d29aef77bad80ec2b3181c4bcceacda94d7cd68750d8b94353c"} Jul 22 01:48:02.900018 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.899974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" event={"ID":"cfcb9752-c785-43e1-ba5d-6328fd02dec9","Type":"ContainerStarted","Data":"5e5ef3327a07a9fae194795d8f3f98fbc1eb69f4ba228d4e5baee6dc5ccac0b3"} Jul 22 01:48:02.901470 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.901401 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" event={"ID":"37952390-fa46-4a89-a529-cf9451d4b668","Type":"ContainerStarted","Data":"23b0d7275edafee5f15e2ca17e835bc5d7dfe7f88ab0bb7ae4d9ccea1f919906"} Jul 22 01:48:02.902736 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.902708 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" event={"ID":"6332509e-066d-40fb-afc4-0eaec4e38234","Type":"ContainerStarted","Data":"52c73b81cbb6ec5b749e759982ae9c3a2a81f63709013a488e99767a0c10fc72"} Jul 22 01:48:02.904110 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.904086 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" event={"ID":"8627ee41-9af2-4187-a91e-e853df0aafd2","Type":"ContainerStarted","Data":"c48ea1aa57f8f8bb2b0a92630a9b2bfc004d64f35ad59797f6f276083c71d388"} Jul 22 01:48:02.905680 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:02.905658 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" event={"ID":"7ea652f8-82c2-498d-b6d0-e51379f5589b","Type":"ContainerStarted","Data":"37fd58c2b7f03220d43ced8cea02d5253e64201a754c142d42f1a7c8a7ccdeca"} Jul 22 01:48:03.126765 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.126697 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:03.186059 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.185981 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.348992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.349040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.349094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.349131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.349362 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.349460 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls podName:7da6a476-31c8-4603-beca-87308caf7237 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:05.349441562 +0000 UTC m=+44.289408819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-m88qg" (UID: "7da6a476-31c8-4603-beca-87308caf7237") : secret "samples-operator-tls" not found Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.349851 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.349900 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:05.349885605 +0000 UTC m=+44.289852844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : secret "router-metrics-certs-default" not found Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.349957 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.349990 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls podName:06c8ad63-a743-4e4f-beaf-68f6f46d2138 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:05.349979511 +0000 UTC m=+44.289946754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2jqm6" (UID: "06c8ad63-a743-4e4f-beaf-68f6f46d2138") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:03.350107 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:03.350066 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:05.350055379 +0000 UTC m=+44.290022636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : configmap references non-existent config key: service-ca.crt Jul 22 01:48:03.914166 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.914126 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" event={"ID":"8627ee41-9af2-4187-a91e-e853df0aafd2","Type":"ContainerStarted","Data":"0ccf249d0d99de1d39c7298d9e2f91cd868da13a455915ea1fc4d1187fb3136b"} Jul 22 01:48:03.932083 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:03.932023 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hdkwk" podStartSLOduration=1.278002532 podStartE2EDuration="2.932001837s" totalImagesPullingTime="1.653999305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:03.929405344 +0000 UTC m=+42.869372606" watchObservedRunningTime="2026-07-22 01:48:03.932001837 +0000 UTC m=+42.871969098" Jul 22 01:48:04.073168 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:04.073081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:04.166190 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:04.166160 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:04.761618 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:04.761579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:04.761791 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:04.761694 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:04.761791 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:04.761713 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:48:04.761791 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:04.761738 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6676fdbc-9n5qj: secret "image-registry-tls" not found Jul 22 01:48:04.761959 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:04.761810 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls podName:fde02c6b-c800-4a8c-bb96-7cb3dfc40224 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:12.761791977 +0000 UTC m=+51.701759235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls") pod "image-registry-7d6676fdbc-9n5qj" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224") : secret "image-registry-tls" not found Jul 22 01:48:04.761959 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:04.761833 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:48:04.761959 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:04.761892 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls podName:ca86d95e-a805-450d-97f8-d4d7d3cfe66f nodeName:}" failed. No retries permitted until 2026-07-22 01:48:12.76187588 +0000 UTC m=+51.701843133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls") pod "dns-default-qvcvb" (UID: "ca86d95e-a805-450d-97f8-d4d7d3cfe66f") : secret "dns-default-metrics-tls" not found Jul 22 01:48:05.368143 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:05.368105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:05.368143 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:05.368143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:05.368194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:05.368227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368259 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368321 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368333 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368325 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:09.368306355 +0000 UTC m=+48.308273617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : secret "router-metrics-certs-default" not found Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368377 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls podName:06c8ad63-a743-4e4f-beaf-68f6f46d2138 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:09.36836428 +0000 UTC m=+48.308331520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2jqm6" (UID: "06c8ad63-a743-4e4f-beaf-68f6f46d2138") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368393 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:09.368386567 +0000 UTC m=+48.308353806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : configmap references non-existent config key: service-ca.crt Jul 22 01:48:05.368571 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:05.368406 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls podName:7da6a476-31c8-4603-beca-87308caf7237 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:09.368399695 +0000 UTC m=+48.308366934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-m88qg" (UID: "7da6a476-31c8-4603-beca-87308caf7237") : secret "samples-operator-tls" not found Jul 22 01:48:06.126955 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:06.126928 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:06.226978 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:06.226948 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:06.331067 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:06.331038 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:07.074237 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:07.074209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:07.173213 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:07.173161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:07.480454 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:07.480419 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:08.160997 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.160962 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:08.260717 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.260683 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:08.932377 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.932211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" event={"ID":"7ea652f8-82c2-498d-b6d0-e51379f5589b","Type":"ContainerStarted","Data":"2a33a226c18c84c38be7c8e5293e93b4e350b62df3a40e66cca5dc069bf83fdf"} Jul 22 01:48:08.933831 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.933796 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" event={"ID":"3110a53c-0213-4a22-aa0e-65395432fd74","Type":"ContainerStarted","Data":"f852682ac39950aa94d6f492c379e8c33867a47332b91749e1d99bca6064cfe0"} Jul 22 01:48:08.935812 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.935787 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" event={"ID":"cfcb9752-c785-43e1-ba5d-6328fd02dec9","Type":"ContainerStarted","Data":"f6da1563d51113cc80446f42d1381d9a5287242d0c194e56fc959b2430c458b7"} Jul 22 01:48:08.937762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.937732 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/0.log" Jul 22 01:48:08.937839 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.937784 2554 generic.go:356] "Generic (PLEG): container finished" podID="37952390-fa46-4a89-a529-cf9451d4b668" containerID="ec4ad4b01c063749c164c94d9b12117d866f5014bfda76c4f19c002abfe52eaf" exitCode=255 Jul 22 01:48:08.937900 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.937868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" event={"ID":"37952390-fa46-4a89-a529-cf9451d4b668","Type":"ContainerDied","Data":"ec4ad4b01c063749c164c94d9b12117d866f5014bfda76c4f19c002abfe52eaf"} Jul 22 01:48:08.938054 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.938035 2554 scope.go:117] "RemoveContainer" containerID="ec4ad4b01c063749c164c94d9b12117d866f5014bfda76c4f19c002abfe52eaf" Jul 22 01:48:08.939394 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.939373 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" event={"ID":"6332509e-066d-40fb-afc4-0eaec4e38234","Type":"ContainerStarted","Data":"87fe475daf3af3563fc40de253b439392db7a9b7bfbfdb39d42ba9fe5904e6ad"} Jul 22 01:48:08.949716 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.949671 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" podStartSLOduration=1.684175952 podStartE2EDuration="7.949651844s" totalImagesPullingTime="6.265475892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:08.9484624 +0000 UTC m=+47.888429662" watchObservedRunningTime="2026-07-22 01:48:08.949651844 +0000 UTC m=+47.889619106" Jul 22 01:48:08.964584 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.964533 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lbmgq" podStartSLOduration=1.672726164 podStartE2EDuration="7.964502323s" totalImagesPullingTime="6.291776159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:08.963009174 +0000 UTC m=+47.902976435" watchObservedRunningTime="2026-07-22 01:48:08.964502323 +0000 UTC m=+47.904469588" Jul 22 01:48:08.978248 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:08.978165 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" podStartSLOduration=1.529259819 podStartE2EDuration="7.978147871s" totalImagesPullingTime="6.448888052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:08.978004978 +0000 UTC m=+47.917972240" watchObservedRunningTime="2026-07-22 01:48:08.978147871 +0000 UTC m=+47.918115131" Jul 22 01:48:09.015173 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.014782 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" podStartSLOduration=1.64248846 podStartE2EDuration="8.014760974s" totalImagesPullingTime="6.372272514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:08.99442936 +0000 UTC m=+47.934396623" watchObservedRunningTime="2026-07-22 01:48:09.014760974 +0000 UTC m=+47.954728235" Jul 22 01:48:09.283760 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.283656 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:09.405184 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.405143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:09.405375 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.405193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:09.405375 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.405241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:09.405375 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.405277 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:09.405375 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405307 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:48:09.405375 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405370 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:09.405641 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405385 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:17.405364451 +0000 UTC m=+56.345331708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : secret "router-metrics-certs-default" not found Jul 22 01:48:09.405641 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405440 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 01:48:09.405641 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405444 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls podName:06c8ad63-a743-4e4f-beaf-68f6f46d2138 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:17.405412106 +0000 UTC m=+56.345379350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2jqm6" (UID: "06c8ad63-a743-4e4f-beaf-68f6f46d2138") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:09.405641 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405482 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls podName:7da6a476-31c8-4603-beca-87308caf7237 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:17.405469166 +0000 UTC m=+56.345436423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-m88qg" (UID: "7da6a476-31c8-4603-beca-87308caf7237") : secret "samples-operator-tls" not found Jul 22 01:48:09.405641 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.405540 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:17.405529639 +0000 UTC m=+56.345496883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : configmap references non-existent config key: service-ca.crt Jul 22 01:48:09.681318 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.681277 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bgtzd"] Jul 22 01:48:09.698899 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.698863 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgtzd"] Jul 22 01:48:09.699037 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.698985 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.701391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.701354 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 01:48:09.701624 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.701610 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2nw2\"" Jul 22 01:48:09.701751 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.701625 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 01:48:09.725399 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.725371 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:09.785314 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.785281 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:09.807562 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.807533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.807701 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.807652 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhb7s\" (UniqueName: \"kubernetes.io/projected/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-api-access-xhb7s\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.807743 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.807707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.807743 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.807728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66ee7c66-0d62-4b83-b770-4a584e1b972d-data-volume\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.807820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.807788 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66ee7c66-0d62-4b83-b770-4a584e1b972d-crio-socket\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.908982 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.908901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66ee7c66-0d62-4b83-b770-4a584e1b972d-crio-socket\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.909264 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.909245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.909473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.909455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhb7s\" (UniqueName: \"kubernetes.io/projected/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-api-access-xhb7s\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.909685 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.909668 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.909800 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.909786 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66ee7c66-0d62-4b83-b770-4a584e1b972d-data-volume\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.910254 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.910234 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66ee7c66-0d62-4b83-b770-4a584e1b972d-data-volume\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.910388 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.909108 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66ee7c66-0d62-4b83-b770-4a584e1b972d-crio-socket\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.910597 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.910581 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:48:09.910733 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.910724 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:10.410701872 +0000 UTC m=+49.350669126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : secret "insights-runtime-extractor-tls" not found Jul 22 01:48:09.911399 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.911379 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:48:09.911575 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.911563 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:10.41153696 +0000 UTC m=+49.351504217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : configmap "kube-rbac-proxy" not found Jul 22 01:48:09.921868 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.921846 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhb7s\" (UniqueName: \"kubernetes.io/projected/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-api-access-xhb7s\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:09.944217 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.944196 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:48:09.944577 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.944563 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/0.log" Jul 22 01:48:09.944627 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.944600 2554 generic.go:356] "Generic (PLEG): container finished" podID="37952390-fa46-4a89-a529-cf9451d4b668" containerID="6c49e483b6a8a67543669365f99de08da0e00c779273f4d0d4ae4e71964f0677" exitCode=255 Jul 22 01:48:09.944730 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.944704 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" event={"ID":"37952390-fa46-4a89-a529-cf9451d4b668","Type":"ContainerDied","Data":"6c49e483b6a8a67543669365f99de08da0e00c779273f4d0d4ae4e71964f0677"} Jul 22 01:48:09.944818 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.944801 2554 scope.go:117] "RemoveContainer" containerID="ec4ad4b01c063749c164c94d9b12117d866f5014bfda76c4f19c002abfe52eaf" Jul 22 01:48:09.944973 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:09.944954 2554 scope.go:117] "RemoveContainer" containerID="6c49e483b6a8a67543669365f99de08da0e00c779273f4d0d4ae4e71964f0677" Jul 22 01:48:09.945290 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:09.945267 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-zq9wq_openshift-console-operator(37952390-fa46-4a89-a529-cf9451d4b668)\"" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" podUID="37952390-fa46-4a89-a529-cf9451d4b668" Jul 22 01:48:10.111339 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.111299 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.213415 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.213384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.293949 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.293908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.362743 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.362717 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.415062 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.415033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:10.415178 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.415095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:10.415178 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:10.415154 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:48:10.415263 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:10.415231 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:11.415214785 +0000 UTC m=+50.355182024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : configmap "kube-rbac-proxy" not found Jul 22 01:48:10.415263 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:10.415253 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:48:10.415341 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:10.415309 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:11.41529607 +0000 UTC m=+50.355263332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : secret "insights-runtime-extractor-tls" not found Jul 22 01:48:10.596452 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.596373 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.673321 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.673287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.861397 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.861318 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:10.948663 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.948636 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:48:10.948953 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.948939 2554 scope.go:117] "RemoveContainer" containerID="6c49e483b6a8a67543669365f99de08da0e00c779273f4d0d4ae4e71964f0677" Jul 22 01:48:10.949109 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:10.949090 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-zq9wq_openshift-console-operator(37952390-fa46-4a89-a529-cf9451d4b668)\"" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" podUID="37952390-fa46-4a89-a529-cf9451d4b668" Jul 22 01:48:10.964502 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:10.964476 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:11.203222 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:11.203191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:11.304350 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:11.304313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:11.424348 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:11.424316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:11.424531 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:11.424471 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:48:11.424531 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:11.424471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:11.424619 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:11.424549 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:13.424531493 +0000 UTC m=+52.364498755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : secret "insights-runtime-extractor-tls" not found Jul 22 01:48:11.424619 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:11.424587 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 01:48:11.424717 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:11.424644 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:13.424631485 +0000 UTC m=+52.364598724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : configmap "kube-rbac-proxy" not found Jul 22 01:48:11.492838 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:11.492770 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7nlt_754f03ce-1f47-4f19-b188-e4f4c7f28d43/dns-node-resolver/0.log" Jul 22 01:48:12.011611 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.011575 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:12.011780 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.011630 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:12.011965 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.011954 2554 scope.go:117] "RemoveContainer" containerID="6c49e483b6a8a67543669365f99de08da0e00c779273f4d0d4ae4e71964f0677" Jul 22 01:48:12.012114 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:12.012096 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-zq9wq_openshift-console-operator(37952390-fa46-4a89-a529-cf9451d4b668)\"" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" podUID="37952390-fa46-4a89-a529-cf9451d4b668" Jul 22 01:48:12.094409 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.094386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98ngj_8cbabdd9-b920-4219-ba7e-0656628d05d8/node-ca/0.log" Jul 22 01:48:12.514131 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.514095 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:12.589084 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.589049 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:12.838889 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.838797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:12.839070 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.838892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:12.839070 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:12.838963 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 01:48:12.839070 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:12.838984 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d6676fdbc-9n5qj: secret "image-registry-tls" not found Jul 22 01:48:12.839070 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:12.839031 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 01:48:12.839070 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:12.839069 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls podName:fde02c6b-c800-4a8c-bb96-7cb3dfc40224 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:28.839049971 +0000 UTC m=+67.779017226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls") pod "image-registry-7d6676fdbc-9n5qj" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224") : secret "image-registry-tls" not found Jul 22 01:48:12.839320 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:12.839087 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls podName:ca86d95e-a805-450d-97f8-d4d7d3cfe66f nodeName:}" failed. No retries permitted until 2026-07-22 01:48:28.839078364 +0000 UTC m=+67.779045603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls") pod "dns-default-qvcvb" (UID: "ca86d95e-a805-450d-97f8-d4d7d3cfe66f") : secret "dns-default-metrics-tls" not found Jul 22 01:48:12.893889 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:12.893860 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lv5wf_4f222ec5-bcc6-404f-8400-1804dacd9332/serve-healthcheck-canary/0.log" Jul 22 01:48:13.047399 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.047360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:13.170367 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.170340 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:13.443893 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.443812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:13.444042 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.443921 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:13.444042 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:13.443962 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:48:13.444042 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:13.444034 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:17.444018927 +0000 UTC m=+56.383986165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : secret "insights-runtime-extractor-tls" not found Jul 22 01:48:13.444388 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.444370 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66ee7c66-0d62-4b83-b770-4a584e1b972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:13.503365 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.503335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:13.632922 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:13.632888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:16.637958 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:16.637929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:16.738855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:16.738825 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:16.902002 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:16.901922 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:16.967024 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:16.966997 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:17.229858 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.229829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:17.330784 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.330749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:17.476980 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.476945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:17.477154 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.477007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:17.477154 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.477027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:17.477154 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.477058 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:17.477154 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.477082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:17.477154 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477094 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 01:48:17.477154 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477152 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls podName:66ee7c66-0d62-4b83-b770-4a584e1b972d nodeName:}" failed. No retries permitted until 2026-07-22 01:48:25.477136324 +0000 UTC m=+64.417103562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgtzd" (UID: "66ee7c66-0d62-4b83-b770-4a584e1b972d") : secret "insights-runtime-extractor-tls" not found Jul 22 01:48:17.477380 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477175 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 01:48:17.477380 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477176 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:17.477380 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477205 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:33.477190592 +0000 UTC m=+72.417157865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : configmap references non-existent config key: service-ca.crt Jul 22 01:48:17.477380 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477243 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs podName:0893a9f4-2552-4b8e-af5a-2e43e0a24618 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:33.477233786 +0000 UTC m=+72.417201025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs") pod "router-default-58fd7458cb-mzkb2" (UID: "0893a9f4-2552-4b8e-af5a-2e43e0a24618") : secret "router-metrics-certs-default" not found Jul 22 01:48:17.477380 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:17.477253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls podName:06c8ad63-a743-4e4f-beaf-68f6f46d2138 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:33.47724759 +0000 UTC m=+72.417214829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2jqm6" (UID: "06c8ad63-a743-4e4f-beaf-68f6f46d2138") : secret "cluster-monitoring-operator-tls" not found Jul 22 01:48:17.479703 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.479683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7da6a476-31c8-4603-beca-87308caf7237-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-m88qg\" (UID: \"7da6a476-31c8-4603-beca-87308caf7237\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:17.537059 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.536956 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" Jul 22 01:48:17.544641 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.544615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:17.701869 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.701840 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg"] Jul 22 01:48:17.922921 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.922893 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:17.969341 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:17.969311 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" event={"ID":"7da6a476-31c8-4603-beca-87308caf7237","Type":"ContainerStarted","Data":"9e4f0a599d7ee956bd64a1262e1517c8a95c30bf6663f009805d9e077ba649e0"} Jul 22 01:48:18.532878 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:18.532846 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:18.927862 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:18.927824 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:19.326339 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:19.326257 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:19.745377 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:19.745344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:20.135882 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.135852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:20.336999 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.336924 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:20.526872 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.526839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:20.592271 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.592199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:20.730662 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.730634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:20.982796 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.982763 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" event={"ID":"7da6a476-31c8-4603-beca-87308caf7237","Type":"ContainerStarted","Data":"7e11e038d0c9cbf0a57a65175b40af21f9699f0b1b8ba6371892342bd0fb9c82"} Jul 22 01:48:20.982958 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.982818 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" event={"ID":"7da6a476-31c8-4603-beca-87308caf7237","Type":"ContainerStarted","Data":"efee382886514d1ce39c7a70bfd0f9ff82c54b6aa131e50c83765cfc720509d4"} Jul 22 01:48:20.998108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:20.998053 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-m88qg" podStartSLOduration=17.909898601 podStartE2EDuration="19.998037965s" totalImagesPullingTime="2.088139364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:20.996929983 +0000 UTC m=+59.936897257" watchObservedRunningTime="2026-07-22 01:48:20.998037965 +0000 UTC m=+59.938005227" Jul 22 01:48:21.323615 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:21.323538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:21.378688 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:21.378660 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:21.952315 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:21.952285 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:22.131953 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:22.131920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:22.330715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:22.330633 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:22.532945 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:22.532911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:22.695957 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:22.695926 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:22.865663 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:22.865634 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgmvf" Jul 22 01:48:22.922032 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:22.921997 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:23.530798 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:23.530772 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:23.920691 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:23.920656 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:24.127887 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:24.127859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:24.329108 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:24.328995 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:24.733069 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:24.733039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:25.000100 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.000018 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:25.324374 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.324296 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:25.524036 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.524005 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:25.545321 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.545283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:25.547889 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.547856 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66ee7c66-0d62-4b83-b770-4a584e1b972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgtzd\" (UID: \"66ee7c66-0d62-4b83-b770-4a584e1b972d\") " pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:25.559058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.559036 2554 scope.go:117] "RemoveContainer" containerID="6c49e483b6a8a67543669365f99de08da0e00c779273f4d0d4ae4e71964f0677" Jul 22 01:48:25.612275 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.612252 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2nw2\"" Jul 22 01:48:25.621159 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.621128 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgtzd" Jul 22 01:48:25.756683 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.756652 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgtzd"] Jul 22 01:48:25.759953 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:25.759921 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ee7c66_0d62_4b83_b770_4a584e1b972d.slice/crio-59a67fd80b6453f0d82048ff46f7771e1a992698952e20c900e85b5c963850c7 WatchSource:0}: Error finding container 59a67fd80b6453f0d82048ff46f7771e1a992698952e20c900e85b5c963850c7: Status 404 returned error can't find the container with id 59a67fd80b6453f0d82048ff46f7771e1a992698952e20c900e85b5c963850c7 Jul 22 01:48:25.938283 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:25.938254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:26.003549 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.003502 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:48:26.003729 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.003624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" event={"ID":"37952390-fa46-4a89-a529-cf9451d4b668","Type":"ContainerStarted","Data":"29e4eb55435b7da361d81693f4ee808539482f56d9b0f75b087ae1fb59c71264"} Jul 22 01:48:26.004117 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.003971 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:26.004907 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.004883 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtzd" event={"ID":"66ee7c66-0d62-4b83-b770-4a584e1b972d","Type":"ContainerStarted","Data":"59a67fd80b6453f0d82048ff46f7771e1a992698952e20c900e85b5c963850c7"} Jul 22 01:48:26.021294 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.021255 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" podStartSLOduration=18.668324136 podStartE2EDuration="25.021241565s" totalImagesPullingTime="6.352917429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:26.019735319 +0000 UTC m=+64.959702572" watchObservedRunningTime="2026-07-22 01:48:26.021241565 +0000 UTC m=+64.961208827" Jul 22 01:48:26.247286 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.247171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:26.361695 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.361624 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:26.505579 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.505298 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-zq9wq" Jul 22 01:48:26.710772 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.710704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:26.811333 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.811217 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:26.875999 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.875963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:26.930269 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:26.930237 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:27.031388 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.031341 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:27.147332 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.147254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:27.247954 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.247920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:27.266152 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.266109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:48:27.266316 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.266166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:48:27.268974 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.268950 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 01:48:27.269104 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.268986 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 01:48:27.279165 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.279145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15fa3782-0966-4522-a79f-79917f4dfd4c-metrics-certs\") pod \"network-metrics-daemon-4zgdb\" (UID: \"15fa3782-0966-4522-a79f-79917f4dfd4c\") " pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:48:27.279301 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.279223 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a104096-a728-4057-b64c-19adf6c03586-original-pull-secret\") pod \"global-pull-secret-syncer-9p4g6\" (UID: \"3a104096-a728-4057-b64c-19adf6c03586\") " pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:48:27.348708 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.348676 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:27.369991 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.369961 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rnbhf\"" Jul 22 01:48:27.372051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.372023 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p4g6" Jul 22 01:48:27.378079 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.378060 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zgdb" Jul 22 01:48:27.450057 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.450024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:27.468137 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.468088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:48:27.472288 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.472033 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2m82\" (UniqueName: \"kubernetes.io/projected/38510339-6bae-4aae-b39b-6d5fe73647a3-kube-api-access-j2m82\") pod \"network-check-target-8cvrx\" (UID: \"38510339-6bae-4aae-b39b-6d5fe73647a3\") " pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:48:27.526334 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.526303 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4zgdb"] Jul 22 01:48:27.531055 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:27.531026 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fa3782_0966_4522_a79f_79917f4dfd4c.slice/crio-d440fe38ea4b7c444d56b634000ebd72b626e36d2879d4510eedbbf82fe2fc9f WatchSource:0}: Error finding container d440fe38ea4b7c444d56b634000ebd72b626e36d2879d4510eedbbf82fe2fc9f: Status 404 returned error can't find the container with id d440fe38ea4b7c444d56b634000ebd72b626e36d2879d4510eedbbf82fe2fc9f Jul 22 01:48:27.543469 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.543442 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9p4g6"] Jul 22 01:48:27.546700 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:27.546670 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a104096_a728_4057_b64c_19adf6c03586.slice/crio-d476190462516a442e50f5047849df5dca364054a84985ffea2e05395fbcec2b WatchSource:0}: Error finding container d476190462516a442e50f5047849df5dca364054a84985ffea2e05395fbcec2b: Status 404 returned error can't find the container with id d476190462516a442e50f5047849df5dca364054a84985ffea2e05395fbcec2b Jul 22 01:48:27.571834 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.571812 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b6r65\"" Jul 22 01:48:27.579833 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.579811 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:48:27.748687 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:27.748650 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8cvrx"] Jul 22 01:48:27.752364 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:27.752337 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38510339_6bae_4aae_b39b_6d5fe73647a3.slice/crio-4596b3e61caad08a2c76692319271c9707cd5a157f9565afe0a84fa140d7a12d WatchSource:0}: Error finding container 4596b3e61caad08a2c76692319271c9707cd5a157f9565afe0a84fa140d7a12d: Status 404 returned error can't find the container with id 4596b3e61caad08a2c76692319271c9707cd5a157f9565afe0a84fa140d7a12d Jul 22 01:48:28.014174 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.014088 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zgdb" event={"ID":"15fa3782-0966-4522-a79f-79917f4dfd4c","Type":"ContainerStarted","Data":"d440fe38ea4b7c444d56b634000ebd72b626e36d2879d4510eedbbf82fe2fc9f"} Jul 22 01:48:28.015468 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.015423 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9p4g6" event={"ID":"3a104096-a728-4057-b64c-19adf6c03586","Type":"ContainerStarted","Data":"d476190462516a442e50f5047849df5dca364054a84985ffea2e05395fbcec2b"} Jul 22 01:48:28.018000 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.017975 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8cvrx" event={"ID":"38510339-6bae-4aae-b39b-6d5fe73647a3","Type":"ContainerStarted","Data":"a05e29245cb02d67e5427efe52ac7821ffe38d963781135c5ad9d007ddf26a11"} Jul 22 01:48:28.018129 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.018012 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8cvrx" event={"ID":"38510339-6bae-4aae-b39b-6d5fe73647a3","Type":"ContainerStarted","Data":"4596b3e61caad08a2c76692319271c9707cd5a157f9565afe0a84fa140d7a12d"} Jul 22 01:48:28.018129 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.018043 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:48:28.592100 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.592017 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:28.780718 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.780684 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:28.843413 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.843337 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:28.880671 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.880380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:28.880671 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.880473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:28.883874 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.883824 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"image-registry-7d6676fdbc-9n5qj\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:28.885074 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.885050 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca86d95e-a805-450d-97f8-d4d7d3cfe66f-metrics-tls\") pod \"dns-default-qvcvb\" (UID: \"ca86d95e-a805-450d-97f8-d4d7d3cfe66f\") " pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:28.913482 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:28.913446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:29.070983 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:29.070950 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c2smp\"" Jul 22 01:48:29.078558 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:29.078332 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:29.094158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:29.094098 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqgw\"" Jul 22 01:48:29.102164 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:29.102135 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:32.069357 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.069296 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8cvrx" podStartSLOduration=70.069273852 podStartE2EDuration="1m10.069273852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:28.034446779 +0000 UTC m=+66.974414041" watchObservedRunningTime="2026-07-22 01:48:32.069273852 +0000 UTC m=+71.009241114" Jul 22 01:48:32.070812 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.070784 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb"] Jul 22 01:48:32.104391 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.104357 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb"] Jul 22 01:48:32.104579 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.104480 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.107284 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.107258 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 01:48:32.107574 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.107557 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 01:48:32.108440 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.108420 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 01:48:32.108659 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.108639 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 22 01:48:32.153460 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.153433 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-khlds"] Jul 22 01:48:32.175678 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.174116 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp"] Jul 22 01:48:32.175678 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.174356 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:32.177192 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.177167 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-86jjq\"" Jul 22 01:48:32.179278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.179250 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 01:48:32.180845 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.180824 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 01:48:32.196762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.196725 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp"] Jul 22 01:48:32.196762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.196759 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-khlds"] Jul 22 01:48:32.197813 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.196849 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.199687 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.199664 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 01:48:32.199938 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.199924 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 01:48:32.200060 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.200040 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m24h4\"" Jul 22 01:48:32.208782 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.208759 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/18111a7c-0f1c-4811-959c-19ba349da672-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.208886 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.208809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6p2\" (UniqueName: \"kubernetes.io/projected/18111a7c-0f1c-4811-959c-19ba349da672-kube-api-access-mg6p2\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.208886 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.208849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18111a7c-0f1c-4811-959c-19ba349da672-tmp\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.211709 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.211688 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:32.308281 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.308239 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:32.309307 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8spr\" (UniqueName: \"kubernetes.io/projected/d4ed1df8-0add-436e-ac57-6548577d8824-kube-api-access-j8spr\") pod \"downloads-5bc67dcd46-khlds\" (UID: \"d4ed1df8-0add-436e-ac57-6548577d8824\") " pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:32.309417 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/18111a7c-0f1c-4811-959c-19ba349da672-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.309487 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69fb37d7-eb51-4077-ac18-1472f0bf039d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nw4sp\" (UID: \"69fb37d7-eb51-4077-ac18-1472f0bf039d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.309487 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6p2\" (UniqueName: \"kubernetes.io/projected/18111a7c-0f1c-4811-959c-19ba349da672-kube-api-access-mg6p2\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.309609 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18111a7c-0f1c-4811-959c-19ba349da672-tmp\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.309609 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69fb37d7-eb51-4077-ac18-1472f0bf039d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nw4sp\" (UID: \"69fb37d7-eb51-4077-ac18-1472f0bf039d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.309922 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.309905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18111a7c-0f1c-4811-959c-19ba349da672-tmp\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.312350 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.312326 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/18111a7c-0f1c-4811-959c-19ba349da672-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.318600 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.318539 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6p2\" (UniqueName: \"kubernetes.io/projected/18111a7c-0f1c-4811-959c-19ba349da672-kube-api-access-mg6p2\") pod \"klusterlet-addon-workmgr-76b74f48cc-qx8wb\" (UID: \"18111a7c-0f1c-4811-959c-19ba349da672\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.407801 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.407715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:32.410812 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.410781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8spr\" (UniqueName: \"kubernetes.io/projected/d4ed1df8-0add-436e-ac57-6548577d8824-kube-api-access-j8spr\") pod \"downloads-5bc67dcd46-khlds\" (UID: \"d4ed1df8-0add-436e-ac57-6548577d8824\") " pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:32.410972 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.410841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69fb37d7-eb51-4077-ac18-1472f0bf039d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nw4sp\" (UID: \"69fb37d7-eb51-4077-ac18-1472f0bf039d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.410972 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.410900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69fb37d7-eb51-4077-ac18-1472f0bf039d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nw4sp\" (UID: \"69fb37d7-eb51-4077-ac18-1472f0bf039d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.411670 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.411648 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69fb37d7-eb51-4077-ac18-1472f0bf039d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nw4sp\" (UID: \"69fb37d7-eb51-4077-ac18-1472f0bf039d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.414882 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.414855 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69fb37d7-eb51-4077-ac18-1472f0bf039d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nw4sp\" (UID: \"69fb37d7-eb51-4077-ac18-1472f0bf039d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.415612 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.415590 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:32.422029 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.422002 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8spr\" (UniqueName: \"kubernetes.io/projected/d4ed1df8-0add-436e-ac57-6548577d8824-kube-api-access-j8spr\") pod \"downloads-5bc67dcd46-khlds\" (UID: \"d4ed1df8-0add-436e-ac57-6548577d8824\") " pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:32.486187 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.486158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:32.507932 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.507910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" Jul 22 01:48:32.509395 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:32.509374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:33.442727 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.442066 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvcvb"] Jul 22 01:48:33.462329 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.462261 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:33.471486 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:33.471332 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca86d95e_a805_450d_97f8_d4d7d3cfe66f.slice/crio-6e2b219d547a2292f1da5f2730e1cd7ee786f0c95abcfbc348724e55c8b3041f WatchSource:0}: Error finding container 6e2b219d547a2292f1da5f2730e1cd7ee786f0c95abcfbc348724e55c8b3041f: Status 404 returned error can't find the container with id 6e2b219d547a2292f1da5f2730e1cd7ee786f0c95abcfbc348724e55c8b3041f Jul 22 01:48:33.524383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.523006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:33.524383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.523061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:33.524383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.523581 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:33.524383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.524269 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d6676fdbc-9n5qj"] Jul 22 01:48:33.525090 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.525046 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0893a9f4-2552-4b8e-af5a-2e43e0a24618-service-ca-bundle\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:33.529792 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.529741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/06c8ad63-a743-4e4f-beaf-68f6f46d2138-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2jqm6\" (UID: \"06c8ad63-a743-4e4f-beaf-68f6f46d2138\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:33.532072 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.531761 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0893a9f4-2552-4b8e-af5a-2e43e0a24618-metrics-certs\") pod \"router-default-58fd7458cb-mzkb2\" (UID: \"0893a9f4-2552-4b8e-af5a-2e43e0a24618\") " pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:33.538830 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.536349 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:33.538830 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.538355 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb"] Jul 22 01:48:33.543018 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:33.542983 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde02c6b_c800_4a8c_bb96_7cb3dfc40224.slice/crio-3f8faacd3fbd21266929b6f424f49a0c70de1636eb703b6ecd48f41773bf23ee WatchSource:0}: Error finding container 3f8faacd3fbd21266929b6f424f49a0c70de1636eb703b6ecd48f41773bf23ee: Status 404 returned error can't find the container with id 3f8faacd3fbd21266929b6f424f49a0c70de1636eb703b6ecd48f41773bf23ee Jul 22 01:48:33.545381 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:33.545275 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18111a7c_0f1c_4811_959c_19ba349da672.slice/crio-79d16d08803abfd69f2e2959a1fabd7ea061a2269f69857e0cf8f008a377eec6 WatchSource:0}: Error finding container 79d16d08803abfd69f2e2959a1fabd7ea061a2269f69857e0cf8f008a377eec6: Status 404 returned error can't find the container with id 79d16d08803abfd69f2e2959a1fabd7ea061a2269f69857e0cf8f008a377eec6 Jul 22 01:48:33.551764 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.551743 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp"] Jul 22 01:48:33.557300 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:33.557265 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fb37d7_eb51_4077_ac18_1472f0bf039d.slice/crio-4845f0c4d9ec7fe170e83f3e34db6b2994c615eefe9a34ba40bbcffe426e1fbd WatchSource:0}: Error finding container 4845f0c4d9ec7fe170e83f3e34db6b2994c615eefe9a34ba40bbcffe426e1fbd: Status 404 returned error can't find the container with id 4845f0c4d9ec7fe170e83f3e34db6b2994c615eefe9a34ba40bbcffe426e1fbd Jul 22 01:48:33.579911 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.579167 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-khlds"] Jul 22 01:48:33.585102 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:33.585071 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ed1df8_0add_436e_ac57_6548577d8824.slice/crio-841b88b74dd3ee25b10600d1ebf6e0794745d35c7ff1fce2be113d5fa2787e9c WatchSource:0}: Error finding container 841b88b74dd3ee25b10600d1ebf6e0794745d35c7ff1fce2be113d5fa2787e9c: Status 404 returned error can't find the container with id 841b88b74dd3ee25b10600d1ebf6e0794745d35c7ff1fce2be113d5fa2787e9c Jul 22 01:48:33.820448 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.820364 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pj7pn\"" Jul 22 01:48:33.825038 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.825014 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wtr6n\"" Jul 22 01:48:33.828635 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.828613 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" Jul 22 01:48:33.833841 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.833823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:33.991424 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:33.991393 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6"] Jul 22 01:48:33.993834 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:33.993809 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c8ad63_a743_4e4f_beaf_68f6f46d2138.slice/crio-7b388508e11268778250db8ccd58d46956e176c9e348023cbf572f1fa1288b53 WatchSource:0}: Error finding container 7b388508e11268778250db8ccd58d46956e176c9e348023cbf572f1fa1288b53: Status 404 returned error can't find the container with id 7b388508e11268778250db8ccd58d46956e176c9e348023cbf572f1fa1288b53 Jul 22 01:48:34.010649 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.010624 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58fd7458cb-mzkb2"] Jul 22 01:48:34.013895 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:34.013863 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0893a9f4_2552_4b8e_af5a_2e43e0a24618.slice/crio-f1302fe9dec182644fdc3a895198a727b071d47a7f20ca62961f331304943126 WatchSource:0}: Error finding container f1302fe9dec182644fdc3a895198a727b071d47a7f20ca62961f331304943126: Status 404 returned error can't find the container with id f1302fe9dec182644fdc3a895198a727b071d47a7f20ca62961f331304943126 Jul 22 01:48:34.043582 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.043544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" event={"ID":"0893a9f4-2552-4b8e-af5a-2e43e0a24618","Type":"ContainerStarted","Data":"f1302fe9dec182644fdc3a895198a727b071d47a7f20ca62961f331304943126"} Jul 22 01:48:34.045145 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.045086 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" event={"ID":"69fb37d7-eb51-4077-ac18-1472f0bf039d","Type":"ContainerStarted","Data":"4845f0c4d9ec7fe170e83f3e34db6b2994c615eefe9a34ba40bbcffe426e1fbd"} Jul 22 01:48:34.050260 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.047679 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zgdb" event={"ID":"15fa3782-0966-4522-a79f-79917f4dfd4c","Type":"ContainerStarted","Data":"71ee465e8a412ef532cbb8364216baff456d42a2f4e4f58206e129fa87f04fb8"} Jul 22 01:48:34.050260 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.047728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zgdb" event={"ID":"15fa3782-0966-4522-a79f-79917f4dfd4c","Type":"ContainerStarted","Data":"bebbdbce8dbac05e3db617d726129e658459c68d02526878f89579e96ea75e1c"} Jul 22 01:48:34.050260 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.050008 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-khlds" event={"ID":"d4ed1df8-0add-436e-ac57-6548577d8824","Type":"ContainerStarted","Data":"841b88b74dd3ee25b10600d1ebf6e0794745d35c7ff1fce2be113d5fa2787e9c"} Jul 22 01:48:34.052273 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.051899 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9p4g6" event={"ID":"3a104096-a728-4057-b64c-19adf6c03586","Type":"ContainerStarted","Data":"746b9cde87ac9441c47bfd76787c803663f0d50dac1b8d5f3547cc12f1255f1c"} Jul 22 01:48:34.053413 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.053387 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" event={"ID":"18111a7c-0f1c-4811-959c-19ba349da672","Type":"ContainerStarted","Data":"79d16d08803abfd69f2e2959a1fabd7ea061a2269f69857e0cf8f008a377eec6"} Jul 22 01:48:34.055158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.055137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" event={"ID":"fde02c6b-c800-4a8c-bb96-7cb3dfc40224","Type":"ContainerStarted","Data":"4315f1b743a2a148ebcf37364441f2543c8af6cf1fe2898df6d63a70c481b2f1"} Jul 22 01:48:34.055296 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.055275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" event={"ID":"fde02c6b-c800-4a8c-bb96-7cb3dfc40224","Type":"ContainerStarted","Data":"3f8faacd3fbd21266929b6f424f49a0c70de1636eb703b6ecd48f41773bf23ee"} Jul 22 01:48:34.055387 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.055308 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:34.056573 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.056538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvcvb" event={"ID":"ca86d95e-a805-450d-97f8-d4d7d3cfe66f","Type":"ContainerStarted","Data":"6e2b219d547a2292f1da5f2730e1cd7ee786f0c95abcfbc348724e55c8b3041f"} Jul 22 01:48:34.058043 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.058018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtzd" event={"ID":"66ee7c66-0d62-4b83-b770-4a584e1b972d","Type":"ContainerStarted","Data":"7e4596f698574ac22ff97a22624ccb2ff367b14c84c9249681c948f650aa1f70"} Jul 22 01:48:34.059320 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.059302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" event={"ID":"06c8ad63-a743-4e4f-beaf-68f6f46d2138","Type":"ContainerStarted","Data":"7b388508e11268778250db8ccd58d46956e176c9e348023cbf572f1fa1288b53"} Jul 22 01:48:34.081303 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.081250 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9p4g6" podStartSLOduration=66.30743527999999 podStartE2EDuration="1m12.081229813s" totalImagesPullingTime="5.773794533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:34.081189494 +0000 UTC m=+73.021156763" watchObservedRunningTime="2026-07-22 01:48:34.081229813 +0000 UTC m=+73.021197070" Jul 22 01:48:34.081939 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.081898 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4zgdb" podStartSLOduration=66.317014372 podStartE2EDuration="1m12.081885482s" totalImagesPullingTime="5.76487111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:34.065788707 +0000 UTC m=+73.005755972" watchObservedRunningTime="2026-07-22 01:48:34.081885482 +0000 UTC m=+73.021852746" Jul 22 01:48:34.102784 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.102729 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" podStartSLOduration=49.102704982 podStartE2EDuration="49.102704982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:34.101691679 +0000 UTC m=+73.041658943" watchObservedRunningTime="2026-07-22 01:48:34.102704982 +0000 UTC m=+73.042672244" Jul 22 01:48:34.196867 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.196824 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:34.260822 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:34.260778 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:35.071754 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:35.071718 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" event={"ID":"0893a9f4-2552-4b8e-af5a-2e43e0a24618","Type":"ContainerStarted","Data":"9e1be1cc4ae5716e29aebc60f8fcc3c1848b6e771ca158342e37031032142b7b"} Jul 22 01:48:35.835208 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:35.835156 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:35.838434 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:35.838132 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:35.867952 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:35.867889 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" podStartSLOduration=34.867866162 podStartE2EDuration="34.867866162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:35.091570559 +0000 UTC m=+74.031537819" watchObservedRunningTime="2026-07-22 01:48:35.867866162 +0000 UTC m=+74.807833424" Jul 22 01:48:36.077637 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:36.077579 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:36.079623 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:36.079386 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58fd7458cb-mzkb2" Jul 22 01:48:37.027535 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:37.027475 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:37.130636 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:37.130587 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:37.225974 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:37.225936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:37.327904 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:37.327766 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:38.843828 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:38.843794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:38.920857 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:38.920820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:41.202866 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:41.202830 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:41.253816 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:41.253788 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:42.828249 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:42.828106 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:42.903370 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:42.903338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:43.479485 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:43.479454 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:43.579208 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:43.579181 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:43.772599 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:43.772534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:43.888315 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:43.888283 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:44.116002 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.115913 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtzd" event={"ID":"66ee7c66-0d62-4b83-b770-4a584e1b972d","Type":"ContainerStarted","Data":"2aa1f77843b304449580b8c51c09bf30de6a63a2ce7c3e35941d488f6df445cc"} Jul 22 01:48:44.117838 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.117810 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" event={"ID":"06c8ad63-a743-4e4f-beaf-68f6f46d2138","Type":"ContainerStarted","Data":"247971eb6dd91733b0c0f1990f253163d6efd62f23e69db94d306da1f9496a4d"} Jul 22 01:48:44.121139 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.121108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" event={"ID":"69fb37d7-eb51-4077-ac18-1472f0bf039d","Type":"ContainerStarted","Data":"6220f3e66e73df46ccafdedf808b71c2f916cb34455bb282c4fe31ab103add7b"} Jul 22 01:48:44.122795 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.122764 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" event={"ID":"18111a7c-0f1c-4811-959c-19ba349da672","Type":"ContainerStarted","Data":"ad87d7a87c2d7273e9b1c7381ed866e225e4f5ac4da643c13530c340afe7c6bb"} Jul 22 01:48:44.123823 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.123796 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:44.125440 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.125390 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" Jul 22 01:48:44.126294 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.126269 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvcvb" event={"ID":"ca86d95e-a805-450d-97f8-d4d7d3cfe66f","Type":"ContainerStarted","Data":"a83467d584e9bfa8033dbb8bb6198fe4085a7da99798f75ae95418ad846abacd"} Jul 22 01:48:44.126390 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.126315 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvcvb" event={"ID":"ca86d95e-a805-450d-97f8-d4d7d3cfe66f","Type":"ContainerStarted","Data":"5fdc3fbefd38cf13bb8ce1c1e2e50a40a33a28019911fb4f26f6dba838677f97"} Jul 22 01:48:44.126390 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.126374 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:44.139424 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.139377 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2jqm6" podStartSLOduration=34.064824584 podStartE2EDuration="43.139363515s" totalImagesPullingTime="9.074538931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:44.138585923 +0000 UTC m=+83.078553188" watchObservedRunningTime="2026-07-22 01:48:44.139363515 +0000 UTC m=+83.079330827" Jul 22 01:48:44.157544 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.157413 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b74f48cc-qx8wb" podStartSLOduration=2.610510571 podStartE2EDuration="12.157394992s" totalImagesPullingTime="9.546884421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:44.157208077 +0000 UTC m=+83.097175341" watchObservedRunningTime="2026-07-22 01:48:44.157394992 +0000 UTC m=+83.097362254" Jul 22 01:48:44.181318 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.181253 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qvcvb" podStartSLOduration=38.586577583 podStartE2EDuration="48.181230402s" totalImagesPullingTime="9.594652819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:44.17907502 +0000 UTC m=+83.119042282" watchObservedRunningTime="2026-07-22 01:48:44.181230402 +0000 UTC m=+83.121197668" Jul 22 01:48:44.199196 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.199138 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nw4sp" podStartSLOduration=2.843281393 podStartE2EDuration="12.199120246s" totalImagesPullingTime="9.355838853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:44.198076811 +0000 UTC m=+83.138044073" watchObservedRunningTime="2026-07-22 01:48:44.199120246 +0000 UTC m=+83.139087508" Jul 22 01:48:44.210202 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.210176 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:44.274225 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.274171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:44.373525 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.373427 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:44.427444 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.427407 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:44.593794 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.593726 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:44.700221 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:44.700182 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:45.415362 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:45.415326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:45.516917 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:45.516886 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:49.083137 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:49.083091 2554 patch_prober.go:28] interesting pod/image-registry-7d6676fdbc-9n5qj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 01:48:49.083599 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:49.083171 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" podUID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 01:48:49.705155 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:49.705094 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:49.776410 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:49.776379 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:49.842883 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:49.842849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:51.330153 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:51.330113 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:51.388951 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:51.388918 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:52.729277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:52.729235 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:52.784157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:52.784125 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:54.134136 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:54.134107 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qvcvb" Jul 22 01:48:54.965968 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:54.965947 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:55.075648 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.075625 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:48:55.174706 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.174671 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgtzd" event={"ID":"66ee7c66-0d62-4b83-b770-4a584e1b972d","Type":"ContainerStarted","Data":"40a6dddeea7d8e95fa70fc2943d58ca61f1f42deed5b34024c54eab965902e44"} Jul 22 01:48:55.176537 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.176480 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-khlds" event={"ID":"d4ed1df8-0add-436e-ac57-6548577d8824","Type":"ContainerStarted","Data":"7a1e4003ddff3569ca620f38cb2b3f055abb5669cf0cfd05df91081bd446ea02"} Jul 22 01:48:55.176675 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.176562 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:55.178316 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.178275 2554 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-khlds container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body= Jul 22 01:48:55.178435 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.178341 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-khlds" podUID="d4ed1df8-0add-436e-ac57-6548577d8824" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" Jul 22 01:48:55.197805 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.197720 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bgtzd" podStartSLOduration=17.379620531 podStartE2EDuration="46.197703803s" totalImagesPullingTime="28.818083272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:48:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:55.195748582 +0000 UTC m=+94.135715845" watchObservedRunningTime="2026-07-22 01:48:55.197703803 +0000 UTC m=+94.137671063" Jul 22 01:48:55.216160 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.216094 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-khlds" podStartSLOduration=1.854672555 podStartE2EDuration="23.216073144s" totalImagesPullingTime="21.361400589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:48:55.2142518 +0000 UTC m=+94.154219056" watchObservedRunningTime="2026-07-22 01:48:55.216073144 +0000 UTC m=+94.156040406" Jul 22 01:48:55.366983 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.366944 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:55.443752 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:55.443716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:56.081544 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.081489 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d6676fdbc-9n5qj"] Jul 22 01:48:56.149084 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.149028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:56.198565 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.198536 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-khlds" Jul 22 01:48:56.205052 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.205011 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:56.554158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.554124 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:56.617736 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.617698 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:56.861261 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:56.861183 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.083691 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.083649 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.156880 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.156788 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zg7h2"] Jul 22 01:48:57.169900 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.169871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.192490 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.192455 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.195112 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.195088 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 01:48:57.195276 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.195255 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 01:48:57.195396 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.195256 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 01:48:57.195396 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.195353 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xs2gv\"" Jul 22 01:48:57.195396 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.195218 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 01:48:57.235216 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235178 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-sys\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-metrics-client-ca\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvzzt\" (UniqueName: \"kubernetes.io/projected/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-kube-api-access-gvzzt\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-wtmp\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-textfile\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-root\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235617 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235641 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.235723 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.235685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-tls\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.241665 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.241636 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.336624 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.336797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.336797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-tls\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.336797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-sys\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.336797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-metrics-client-ca\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.336797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvzzt\" (UniqueName: \"kubernetes.io/projected/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-kube-api-access-gvzzt\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337057 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-wtmp\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337057 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-textfile\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337057 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-root\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337057 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.336978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-root\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.337604 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-metrics-client-ca\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337753 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.337636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337753 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.337683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-sys\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.337753 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:57.337724 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 01:48:57.337908 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:48:57.337776 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-tls podName:25c6b2e3-09dd-48ad-9a57-5acbb839eec6 nodeName:}" failed. No retries permitted until 2026-07-22 01:48:57.837758883 +0000 UTC m=+96.777726124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-tls") pod "node-exporter-zg7h2" (UID: "25c6b2e3-09dd-48ad-9a57-5acbb839eec6") : secret "node-exporter-tls" not found Jul 22 01:48:57.337908 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.337798 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-wtmp\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.338200 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.338168 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-textfile\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.340585 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.340537 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.342564 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.342490 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.346019 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.345994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvzzt\" (UniqueName: \"kubernetes.io/projected/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-kube-api-access-gvzzt\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.416157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.416123 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.520522 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.520472 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.580071 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.580042 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.641090 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.641059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.743170 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.743088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:57.841660 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.841626 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-tls\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:57.844433 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:57.844407 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/25c6b2e3-09dd-48ad-9a57-5acbb839eec6-node-exporter-tls\") pod \"node-exporter-zg7h2\" (UID: \"25c6b2e3-09dd-48ad-9a57-5acbb839eec6\") " pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:58.081759 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:58.081677 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:58.103664 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:58.103634 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zg7h2" Jul 22 01:48:58.132227 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:48:58.132194 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c6b2e3_09dd_48ad_9a57_5acbb839eec6.slice/crio-19af808813662fb15f039f3a5653d447c954484f71fcabd9fb086b4b4b631637 WatchSource:0}: Error finding container 19af808813662fb15f039f3a5653d447c954484f71fcabd9fb086b4b4b631637: Status 404 returned error can't find the container with id 19af808813662fb15f039f3a5653d447c954484f71fcabd9fb086b4b4b631637 Jul 22 01:48:58.171554 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:58.171496 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:58.192163 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:58.192128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg7h2" event={"ID":"25c6b2e3-09dd-48ad-9a57-5acbb839eec6","Type":"ContainerStarted","Data":"19af808813662fb15f039f3a5653d447c954484f71fcabd9fb086b4b4b631637"} Jul 22 01:48:58.413209 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:58.413106 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:59.595827 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:59.595787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:48:59.696273 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:48:59.696234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:00.030022 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.029977 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8cvrx" Jul 22 01:49:00.168426 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.168399 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:00.203082 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.203042 2554 generic.go:356] "Generic (PLEG): container finished" podID="25c6b2e3-09dd-48ad-9a57-5acbb839eec6" containerID="4364eb4970dc94f8562be239654df42c9b7b649638bf39035c757056353fc763" exitCode=0 Jul 22 01:49:00.203252 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.203157 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg7h2" event={"ID":"25c6b2e3-09dd-48ad-9a57-5acbb839eec6","Type":"ContainerDied","Data":"4364eb4970dc94f8562be239654df42c9b7b649638bf39035c757056353fc763"} Jul 22 01:49:00.233903 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.233875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:00.300709 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.300675 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:00.368485 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.368429 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:00.561734 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:00.561695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:01.209978 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:01.209943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg7h2" event={"ID":"25c6b2e3-09dd-48ad-9a57-5acbb839eec6","Type":"ContainerStarted","Data":"5ad9ce9f5f31f1671b5dc1bbf0c55b6ae33da1d4523c5355402740da0d447f10"} Jul 22 01:49:01.210419 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:01.209994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zg7h2" event={"ID":"25c6b2e3-09dd-48ad-9a57-5acbb839eec6","Type":"ContainerStarted","Data":"16b1316f473ea2ea5d047a2371da3009196903a99a9c19346f4cbacdf7e1bf64"} Jul 22 01:49:01.230970 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:01.230915 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zg7h2" podStartSLOduration=2.632313356 podStartE2EDuration="4.230898684s" totalImagesPullingTime="1.504056363s" totalInitContainerRuntime="94.528965ms" isStatefulPod=true podCreationTimestamp="2026-07-22 01:48:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:49:01.229751296 +0000 UTC m=+100.169718569" watchObservedRunningTime="2026-07-22 01:49:01.230898684 +0000 UTC m=+100.170865946" Jul 22 01:49:01.903992 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:01.903956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:01.966877 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:01.966843 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:02.066690 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:02.066658 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:02.169117 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:02.169088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:02.327327 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:02.327297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:02.680447 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:02.680414 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:02.777523 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:02.777470 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:03.416719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:03.416686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:03.511682 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:03.511646 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:04.275412 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:04.275383 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:04.354790 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:04.354712 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:04.473756 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:04.473722 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:06.109701 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:06.109671 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:06.160967 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:06.160937 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:09.301862 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:09.301823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:09.402137 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:09.402102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:11.206602 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:11.206570 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:11.270269 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:11.270243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:12.459142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:12.459109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:12.577285 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:12.577253 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:12.695233 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:12.695200 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:12.941007 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:12.940974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:19.279054 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:19.279020 2554 generic.go:356] "Generic (PLEG): container finished" podID="6332509e-066d-40fb-afc4-0eaec4e38234" containerID="87fe475daf3af3563fc40de253b439392db7a9b7bfbfdb39d42ba9fe5904e6ad" exitCode=0 Jul 22 01:49:19.279576 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:19.279102 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" event={"ID":"6332509e-066d-40fb-afc4-0eaec4e38234","Type":"ContainerDied","Data":"87fe475daf3af3563fc40de253b439392db7a9b7bfbfdb39d42ba9fe5904e6ad"} Jul 22 01:49:19.279576 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:19.279543 2554 scope.go:117] "RemoveContainer" containerID="87fe475daf3af3563fc40de253b439392db7a9b7bfbfdb39d42ba9fe5904e6ad" Jul 22 01:49:20.284665 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:20.284605 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-rcksc" event={"ID":"6332509e-066d-40fb-afc4-0eaec4e38234","Type":"ContainerStarted","Data":"d69fc95119c2dd9d4f0016855500495d285cebdd0d417846747e6d1c5a3cbe07"} Jul 22 01:49:20.285969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:20.285946 2554 generic.go:356] "Generic (PLEG): container finished" podID="7ea652f8-82c2-498d-b6d0-e51379f5589b" containerID="2a33a226c18c84c38be7c8e5293e93b4e350b62df3a40e66cca5dc069bf83fdf" exitCode=0 Jul 22 01:49:20.286079 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:20.286022 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" event={"ID":"7ea652f8-82c2-498d-b6d0-e51379f5589b","Type":"ContainerDied","Data":"2a33a226c18c84c38be7c8e5293e93b4e350b62df3a40e66cca5dc069bf83fdf"} Jul 22 01:49:20.286308 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:20.286295 2554 scope.go:117] "RemoveContainer" containerID="2a33a226c18c84c38be7c8e5293e93b4e350b62df3a40e66cca5dc069bf83fdf" Jul 22 01:49:21.107885 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.107832 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" podUID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" containerName="registry" containerID="cri-o://4315f1b743a2a148ebcf37364441f2543c8af6cf1fe2898df6d63a70c481b2f1" gracePeriod=30 Jul 22 01:49:21.293823 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.293792 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-vl6n4" event={"ID":"7ea652f8-82c2-498d-b6d0-e51379f5589b","Type":"ContainerStarted","Data":"22ddaf2b42d016634c639c584e76220101988d316457b9e1fbb5de9d99b0bc15"} Jul 22 01:49:21.295804 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.295775 2554 generic.go:356] "Generic (PLEG): container finished" podID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" containerID="4315f1b743a2a148ebcf37364441f2543c8af6cf1fe2898df6d63a70c481b2f1" exitCode=0 Jul 22 01:49:21.295942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.295836 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" event={"ID":"fde02c6b-c800-4a8c-bb96-7cb3dfc40224","Type":"ContainerDied","Data":"4315f1b743a2a148ebcf37364441f2543c8af6cf1fe2898df6d63a70c481b2f1"} Jul 22 01:49:21.396493 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.396464 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:49:21.547652 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547619 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-installation-pull-secrets\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.547652 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547658 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-ca-trust-extracted\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.547851 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547712 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-bound-sa-token\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.547851 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547757 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-trusted-ca\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.547851 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547789 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-certificates\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.547851 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547814 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-image-registry-private-configuration\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.548039 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547859 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvltc\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-kube-api-access-nvltc\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.548225 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.548189 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:21.548551 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.547901 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") pod \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\" (UID: \"fde02c6b-c800-4a8c-bb96-7cb3dfc40224\") " Jul 22 01:49:21.548551 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.548258 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 01:49:21.548701 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.548679 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-trusted-ca\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.548762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.548709 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-certificates\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.550410 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.550368 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:49:21.550553 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.550478 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:49:21.550709 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.550680 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:49:21.550830 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.550784 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-kube-api-access-nvltc" (OuterVolumeSpecName: "kube-api-access-nvltc") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "kube-api-access-nvltc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:49:21.550830 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.550820 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:49:21.556383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.556363 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fde02c6b-c800-4a8c-bb96-7cb3dfc40224" (UID: "fde02c6b-c800-4a8c-bb96-7cb3dfc40224"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:49:21.650027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.649952 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-bound-sa-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.650027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.649979 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-image-registry-private-configuration\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.650027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.649989 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvltc\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-kube-api-access-nvltc\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.650027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.649998 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-registry-tls\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.650027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.650007 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-installation-pull-secrets\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:21.650027 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:21.650015 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fde02c6b-c800-4a8c-bb96-7cb3dfc40224-ca-trust-extracted\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:49:22.301196 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:22.301168 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" Jul 22 01:49:22.301707 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:22.301167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d6676fdbc-9n5qj" event={"ID":"fde02c6b-c800-4a8c-bb96-7cb3dfc40224","Type":"ContainerDied","Data":"3f8faacd3fbd21266929b6f424f49a0c70de1636eb703b6ecd48f41773bf23ee"} Jul 22 01:49:22.301707 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:22.301292 2554 scope.go:117] "RemoveContainer" containerID="4315f1b743a2a148ebcf37364441f2543c8af6cf1fe2898df6d63a70c481b2f1" Jul 22 01:49:22.317755 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:22.317731 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d6676fdbc-9n5qj"] Jul 22 01:49:22.320920 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:22.320902 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d6676fdbc-9n5qj"] Jul 22 01:49:23.563488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:23.563450 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" path="/var/lib/kubelet/pods/fde02c6b-c800-4a8c-bb96-7cb3dfc40224/volumes" Jul 22 01:49:26.208784 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:26.208751 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:26.309496 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:26.309467 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:32.579265 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:32.579233 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:35.350703 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:35.350664 2554 generic.go:356] "Generic (PLEG): container finished" podID="cfcb9752-c785-43e1-ba5d-6328fd02dec9" containerID="f6da1563d51113cc80446f42d1381d9a5287242d0c194e56fc959b2430c458b7" exitCode=0 Jul 22 01:49:35.351178 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:35.350711 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" event={"ID":"cfcb9752-c785-43e1-ba5d-6328fd02dec9","Type":"ContainerDied","Data":"f6da1563d51113cc80446f42d1381d9a5287242d0c194e56fc959b2430c458b7"} Jul 22 01:49:35.351178 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:35.351128 2554 scope.go:117] "RemoveContainer" containerID="f6da1563d51113cc80446f42d1381d9a5287242d0c194e56fc959b2430c458b7" Jul 22 01:49:35.359908 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:35.359887 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:35.460655 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:35.460627 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:49:36.355656 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:49:36.355618 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q5h5g" event={"ID":"cfcb9752-c785-43e1-ba5d-6328fd02dec9","Type":"ContainerStarted","Data":"2a47e7d4d80d96bd75c7552a470a33d84b71517efbbc5ee8fb1edad3a5ae7058"} Jul 22 01:50:15.102636 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:15.102556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:16.483808 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:16.483775 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:16.739033 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:16.738951 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:21.565465 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.565431 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d55f94558-kfff8"] Jul 22 01:50:21.565837 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.565703 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" containerName="registry" Jul 22 01:50:21.565837 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.565714 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" containerName="registry" Jul 22 01:50:21.565837 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.565772 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde02c6b-c800-4a8c-bb96-7cb3dfc40224" containerName="registry" Jul 22 01:50:21.568358 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.568339 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.570980 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.570945 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 01:50:21.571091 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.570998 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 01:50:21.571300 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.571281 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 01:50:21.571459 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.571435 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wlcvb\"" Jul 22 01:50:21.571593 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.571540 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 01:50:21.571593 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.571572 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 01:50:21.577859 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.577822 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 01:50:21.581700 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.581680 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d55f94558-kfff8"] Jul 22 01:50:21.707792 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707745 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.707792 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-federate-client-tls\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.708045 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.708045 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-metrics-client-ca\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.708045 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvxm\" (UniqueName: \"kubernetes.io/projected/481f8af7-3e6b-43d4-a57d-1024af917dca-kube-api-access-flvxm\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.708045 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-telemeter-client-tls\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.708045 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.707961 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-secret-telemeter-client\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.708246 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.708056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-serving-certs-ca-bundle\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.809657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.809820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-federate-client-tls\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.809820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.809820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-metrics-client-ca\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.809820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flvxm\" (UniqueName: \"kubernetes.io/projected/481f8af7-3e6b-43d4-a57d-1024af917dca-kube-api-access-flvxm\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.809820 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-telemeter-client-tls\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.810067 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-secret-telemeter-client\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.810067 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.809884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-serving-certs-ca-bundle\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.810764 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.810735 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-serving-certs-ca-bundle\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.811484 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.811454 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.814653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.814625 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-federate-client-tls\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.815348 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.815312 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/481f8af7-3e6b-43d4-a57d-1024af917dca-metrics-client-ca\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.816765 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.816744 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-telemeter-client-tls\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.816856 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.816825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.817006 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.816987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/481f8af7-3e6b-43d4-a57d-1024af917dca-secret-telemeter-client\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.822202 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.822177 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvxm\" (UniqueName: \"kubernetes.io/projected/481f8af7-3e6b-43d4-a57d-1024af917dca-kube-api-access-flvxm\") pod \"telemeter-client-d55f94558-kfff8\" (UID: \"481f8af7-3e6b-43d4-a57d-1024af917dca\") " pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:21.883255 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:21.883221 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" Jul 22 01:50:22.018186 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:22.018159 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d55f94558-kfff8"] Jul 22 01:50:22.020097 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:50:22.020074 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481f8af7_3e6b_43d4_a57d_1024af917dca.slice/crio-d3e083fe1c582cbfb1257428792e9bfee87b52d0ab9751b7ddbc66cbc2603e04 WatchSource:0}: Error finding container d3e083fe1c582cbfb1257428792e9bfee87b52d0ab9751b7ddbc66cbc2603e04: Status 404 returned error can't find the container with id d3e083fe1c582cbfb1257428792e9bfee87b52d0ab9751b7ddbc66cbc2603e04 Jul 22 01:50:22.525256 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:22.525222 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" event={"ID":"481f8af7-3e6b-43d4-a57d-1024af917dca","Type":"ContainerStarted","Data":"d3e083fe1c582cbfb1257428792e9bfee87b52d0ab9751b7ddbc66cbc2603e04"} Jul 22 01:50:24.534715 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:24.534675 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" event={"ID":"481f8af7-3e6b-43d4-a57d-1024af917dca","Type":"ContainerStarted","Data":"51a1700e19d40dc8bdf7d9486af07f361774059d218f9c369e68b6e6d372d9a1"} Jul 22 01:50:24.705806 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:50:24.705769 2554 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e7043f7b1d66efc88fcedcc01b99d115878df57141967497a3bdf8f8deeef945" Jul 22 01:50:24.705978 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:50:24.705895 2554 kuberuntime_manager.go:1459] "Unhandled Error" err="container reload start failed in pod telemeter-client-d55f94558-kfff8_openshift-monitoring(481f8af7-3e6b-43d4-a57d-1024af917dca): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 22 01:50:24.766468 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:50:24.766433 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"reload\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" podUID="481f8af7-3e6b-43d4-a57d-1024af917dca" Jul 22 01:50:25.540526 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:25.540468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" event={"ID":"481f8af7-3e6b-43d4-a57d-1024af917dca","Type":"ContainerStarted","Data":"b8f8513ccc79dde64ab4773c2b3a7db133ef68957e2957a5b26502f213808701"} Jul 22 01:50:25.541698 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:50:25.541674 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"reload\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e7043f7b1d66efc88fcedcc01b99d115878df57141967497a3bdf8f8deeef945\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" podUID="481f8af7-3e6b-43d4-a57d-1024af917dca" Jul 22 01:50:26.545564 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:50:26.545502 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"reload\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e7043f7b1d66efc88fcedcc01b99d115878df57141967497a3bdf8f8deeef945\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" podUID="481f8af7-3e6b-43d4-a57d-1024af917dca" Jul 22 01:50:39.590813 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:39.590777 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" event={"ID":"481f8af7-3e6b-43d4-a57d-1024af917dca","Type":"ContainerStarted","Data":"5bcdd517776a69983d357106b49387f46e0a3b8a1de33b80d40a0fbdd90fc9e2"} Jul 22 01:50:39.612889 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:39.612834 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d55f94558-kfff8" podStartSLOduration=2.068142914 podStartE2EDuration="18.612814008s" totalImagesPullingTime="16.544671094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:50:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-22 01:50:39.612179404 +0000 UTC m=+198.552146665" watchObservedRunningTime="2026-07-22 01:50:39.612814008 +0000 UTC m=+198.552781270" Jul 22 01:50:40.501943 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:40.501904 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:40.555850 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:40.555823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:40.658746 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:40.658716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:40.759392 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:40.759310 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:45.282780 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:45.282749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:45.336021 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:45.335993 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:45.948180 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:45.948146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:46.546938 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:46.546907 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:52.656955 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:52.656924 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:52.761921 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:52.761884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:56.003264 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:56.003227 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:56.056794 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:56.056767 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:56.118152 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:56.118117 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:56.220417 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:56.220385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:50:56.319429 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:50:56.319353 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:06.539819 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:06.539787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:46.287144 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:46.287107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:46.389252 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:46.389217 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:53.928717 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:53.928679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:54.025565 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.025532 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:51:54.610628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.610598 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh"] Jul 22 01:51:54.613798 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.613778 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.616137 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.616118 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmb4g\"" Jul 22 01:51:54.616245 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.616225 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:51:54.616307 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.616230 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:51:54.622617 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.622592 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh"] Jul 22 01:51:54.654662 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.654625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.654662 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.654661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxxx6\" (UniqueName: \"kubernetes.io/projected/8273a329-b26e-4786-8441-a284d186df49-kube-api-access-sxxx6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.654851 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.654779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.755179 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.755141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.755179 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.755182 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxxx6\" (UniqueName: \"kubernetes.io/projected/8273a329-b26e-4786-8441-a284d186df49-kube-api-access-sxxx6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.755383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.755246 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.755565 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.755541 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.755612 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.755566 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.773844 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.773806 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxxx6\" (UniqueName: \"kubernetes.io/projected/8273a329-b26e-4786-8441-a284d186df49-kube-api-access-sxxx6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:54.924259 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:54.924227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:51:55.079646 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:55.079617 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh"] Jul 22 01:51:55.083924 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:51:55.083898 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8273a329_b26e_4786_8441_a284d186df49.slice/crio-cdda4598f02af7bc091175a328b5255ed3895bf1f0dac556272f103016bb6f86 WatchSource:0}: Error finding container cdda4598f02af7bc091175a328b5255ed3895bf1f0dac556272f103016bb6f86: Status 404 returned error can't find the container with id cdda4598f02af7bc091175a328b5255ed3895bf1f0dac556272f103016bb6f86 Jul 22 01:51:55.877383 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:51:55.877349 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" event={"ID":"8273a329-b26e-4786-8441-a284d186df49","Type":"ContainerStarted","Data":"cdda4598f02af7bc091175a328b5255ed3895bf1f0dac556272f103016bb6f86"} Jul 22 01:52:01.903891 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:01.903854 2554 generic.go:356] "Generic (PLEG): container finished" podID="8273a329-b26e-4786-8441-a284d186df49" containerID="02eca280ee73fe5a3d174fecf5a81d6e69287573bf548e74f49763727de2d840" exitCode=0 Jul 22 01:52:01.904342 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:01.903938 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" event={"ID":"8273a329-b26e-4786-8441-a284d186df49","Type":"ContainerDied","Data":"02eca280ee73fe5a3d174fecf5a81d6e69287573bf548e74f49763727de2d840"} Jul 22 01:52:04.924930 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:04.924893 2554 generic.go:356] "Generic (PLEG): container finished" podID="8273a329-b26e-4786-8441-a284d186df49" containerID="e75fc06c1322190b157fbc1353f2b31a914801c81b08d5bc54cdcb80adb771c5" exitCode=0 Jul 22 01:52:04.925303 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:04.924972 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" event={"ID":"8273a329-b26e-4786-8441-a284d186df49","Type":"ContainerDied","Data":"e75fc06c1322190b157fbc1353f2b31a914801c81b08d5bc54cdcb80adb771c5"} Jul 22 01:52:11.957206 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:11.957173 2554 generic.go:356] "Generic (PLEG): container finished" podID="8273a329-b26e-4786-8441-a284d186df49" containerID="a0438bccec7297c07577c5daf46ef0c564d2d8815612dbaee374c64c2b7c2f7e" exitCode=0 Jul 22 01:52:11.957623 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:11.957237 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" event={"ID":"8273a329-b26e-4786-8441-a284d186df49","Type":"ContainerDied","Data":"a0438bccec7297c07577c5daf46ef0c564d2d8815612dbaee374c64c2b7c2f7e"} Jul 22 01:52:13.088378 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.088345 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:52:13.203940 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.203901 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxxx6\" (UniqueName: \"kubernetes.io/projected/8273a329-b26e-4786-8441-a284d186df49-kube-api-access-sxxx6\") pod \"8273a329-b26e-4786-8441-a284d186df49\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " Jul 22 01:52:13.203940 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.203949 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-bundle\") pod \"8273a329-b26e-4786-8441-a284d186df49\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " Jul 22 01:52:13.204157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.203970 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-util\") pod \"8273a329-b26e-4786-8441-a284d186df49\" (UID: \"8273a329-b26e-4786-8441-a284d186df49\") " Jul 22 01:52:13.204791 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.204683 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-bundle" (OuterVolumeSpecName: "bundle") pod "8273a329-b26e-4786-8441-a284d186df49" (UID: "8273a329-b26e-4786-8441-a284d186df49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:52:13.206300 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.206278 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8273a329-b26e-4786-8441-a284d186df49-kube-api-access-sxxx6" (OuterVolumeSpecName: "kube-api-access-sxxx6") pod "8273a329-b26e-4786-8441-a284d186df49" (UID: "8273a329-b26e-4786-8441-a284d186df49"). InnerVolumeSpecName "kube-api-access-sxxx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:52:13.209195 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.209177 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-util" (OuterVolumeSpecName: "util") pod "8273a329-b26e-4786-8441-a284d186df49" (UID: "8273a329-b26e-4786-8441-a284d186df49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:52:13.304964 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.304866 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxxx6\" (UniqueName: \"kubernetes.io/projected/8273a329-b26e-4786-8441-a284d186df49-kube-api-access-sxxx6\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:52:13.304964 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.304907 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:52:13.304964 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.304916 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8273a329-b26e-4786-8441-a284d186df49-util\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:52:13.966650 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.966617 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" event={"ID":"8273a329-b26e-4786-8441-a284d186df49","Type":"ContainerDied","Data":"cdda4598f02af7bc091175a328b5255ed3895bf1f0dac556272f103016bb6f86"} Jul 22 01:52:13.966650 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.966643 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bnqhh" Jul 22 01:52:13.966840 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:13.966662 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdda4598f02af7bc091175a328b5255ed3895bf1f0dac556272f103016bb6f86" Jul 22 01:52:15.591120 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:15.591079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:16.382791 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:16.382761 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:17.526336 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526305 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb"] Jul 22 01:52:17.526745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526697 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="util" Jul 22 01:52:17.526745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526709 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="util" Jul 22 01:52:17.526745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526721 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="extract" Jul 22 01:52:17.526745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526728 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="extract" Jul 22 01:52:17.526745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526736 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="pull" Jul 22 01:52:17.526745 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526742 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="pull" Jul 22 01:52:17.526928 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.526812 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8273a329-b26e-4786-8441-a284d186df49" containerName="extract" Jul 22 01:52:17.549115 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.549089 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb"] Jul 22 01:52:17.549279 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.549186 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.551729 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.551703 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:52:17.551906 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.551774 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-c5v52\"" Jul 22 01:52:17.551906 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.551795 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 22 01:52:17.643227 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.643188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdjc\" (UniqueName: \"kubernetes.io/projected/cc89b93e-2fc2-4c41-9452-fbf305d7f7d9-kube-api-access-7hdjc\") pod \"cert-manager-operator-controller-manager-55c444bf86-6svxb\" (UID: \"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.643227 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.643227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc89b93e-2fc2-4c41-9452-fbf305d7f7d9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6svxb\" (UID: \"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.743797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.743756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdjc\" (UniqueName: \"kubernetes.io/projected/cc89b93e-2fc2-4c41-9452-fbf305d7f7d9-kube-api-access-7hdjc\") pod \"cert-manager-operator-controller-manager-55c444bf86-6svxb\" (UID: \"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.743998 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.743806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc89b93e-2fc2-4c41-9452-fbf305d7f7d9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6svxb\" (UID: \"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.744142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.744126 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc89b93e-2fc2-4c41-9452-fbf305d7f7d9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6svxb\" (UID: \"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.751840 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.751813 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdjc\" (UniqueName: \"kubernetes.io/projected/cc89b93e-2fc2-4c41-9452-fbf305d7f7d9-kube-api-access-7hdjc\") pod \"cert-manager-operator-controller-manager-55c444bf86-6svxb\" (UID: \"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:17.858556 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:17.858445 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" Jul 22 01:52:18.007665 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:18.007634 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb"] Jul 22 01:52:18.011498 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:52:18.011461 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc89b93e_2fc2_4c41_9452_fbf305d7f7d9.slice/crio-0ecd8846a5828f377523c4a6b2e9365473de627f2351ef31de4ca3344b278ca9 WatchSource:0}: Error finding container 0ecd8846a5828f377523c4a6b2e9365473de627f2351ef31de4ca3344b278ca9: Status 404 returned error can't find the container with id 0ecd8846a5828f377523c4a6b2e9365473de627f2351ef31de4ca3344b278ca9 Jul 22 01:52:18.988918 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:18.988881 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" event={"ID":"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9","Type":"ContainerStarted","Data":"0ecd8846a5828f377523c4a6b2e9365473de627f2351ef31de4ca3344b278ca9"} Jul 22 01:52:19.261608 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:19.261537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:19.373803 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:19.373770 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:21.001638 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.001595 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" event={"ID":"cc89b93e-2fc2-4c41-9452-fbf305d7f7d9","Type":"ContainerStarted","Data":"bb967a80677e07e6018de90f01129e8b4c0a187e4e181c6689a2742389dc14a3"} Jul 22 01:52:21.028822 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.028770 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6svxb" podStartSLOduration=1.8643929620000002 podStartE2EDuration="4.028751746s" totalImagesPullingTime="2.164358784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:52:21.026350667 +0000 UTC m=+299.966317929" watchObservedRunningTime="2026-07-22 01:52:21.028751746 +0000 UTC m=+299.968719007" Jul 22 01:52:21.078821 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.078788 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:21.178576 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.178539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:21.398184 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.398107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:21.491911 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.491886 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:52:21.496154 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.496132 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:52:21.510035 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.510011 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 01:52:21.523249 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:21.523225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:22.248269 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.248235 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wqqwp"] Jul 22 01:52:22.269284 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.269251 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wqqwp"] Jul 22 01:52:22.269437 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.269394 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.271865 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.271846 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 01:52:22.272741 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.272721 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9lwd2\"" Jul 22 01:52:22.272833 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.272754 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 01:52:22.383833 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.383798 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trzb\" (UniqueName: \"kubernetes.io/projected/ea9feab3-20cb-4a61-8c4b-5199532aebb0-kube-api-access-9trzb\") pod \"cert-manager-webhook-6486ffd997-wqqwp\" (UID: \"ea9feab3-20cb-4a61-8c4b-5199532aebb0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.384008 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.383912 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea9feab3-20cb-4a61-8c4b-5199532aebb0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wqqwp\" (UID: \"ea9feab3-20cb-4a61-8c4b-5199532aebb0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.485026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.484994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea9feab3-20cb-4a61-8c4b-5199532aebb0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wqqwp\" (UID: \"ea9feab3-20cb-4a61-8c4b-5199532aebb0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.485026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.485035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trzb\" (UniqueName: \"kubernetes.io/projected/ea9feab3-20cb-4a61-8c4b-5199532aebb0-kube-api-access-9trzb\") pod \"cert-manager-webhook-6486ffd997-wqqwp\" (UID: \"ea9feab3-20cb-4a61-8c4b-5199532aebb0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.495000 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.494966 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea9feab3-20cb-4a61-8c4b-5199532aebb0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wqqwp\" (UID: \"ea9feab3-20cb-4a61-8c4b-5199532aebb0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.495117 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.495025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trzb\" (UniqueName: \"kubernetes.io/projected/ea9feab3-20cb-4a61-8c4b-5199532aebb0-kube-api-access-9trzb\") pod \"cert-manager-webhook-6486ffd997-wqqwp\" (UID: \"ea9feab3-20cb-4a61-8c4b-5199532aebb0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.589270 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.589182 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:22.744172 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.744122 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wqqwp"] Jul 22 01:52:22.746817 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:52:22.746789 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea9feab3_20cb_4a61_8c4b_5199532aebb0.slice/crio-2e7aeb106d89a9a68fb9adbd77dc8a793eeaba7057d7891cff173b4687271741 WatchSource:0}: Error finding container 2e7aeb106d89a9a68fb9adbd77dc8a793eeaba7057d7891cff173b4687271741: Status 404 returned error can't find the container with id 2e7aeb106d89a9a68fb9adbd77dc8a793eeaba7057d7891cff173b4687271741 Jul 22 01:52:22.748853 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:22.748835 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:52:23.011433 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:23.011396 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" event={"ID":"ea9feab3-20cb-4a61-8c4b-5199532aebb0","Type":"ContainerStarted","Data":"2e7aeb106d89a9a68fb9adbd77dc8a793eeaba7057d7891cff173b4687271741"} Jul 22 01:52:23.088332 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:23.088303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:23.473961 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:23.473909 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:26.026204 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:26.026171 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" event={"ID":"ea9feab3-20cb-4a61-8c4b-5199532aebb0","Type":"ContainerStarted","Data":"0dc4c93382f4b617b35bb50498dea76cd0e1c3b77e51cb14e66643a1e435dd56"} Jul 22 01:52:26.026607 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:26.026222 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:26.040942 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:26.040899 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" podStartSLOduration=1.45128381 podStartE2EDuration="4.040882904s" totalImagesPullingTime="2.589599094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:52:26.04062998 +0000 UTC m=+304.980597241" watchObservedRunningTime="2026-07-22 01:52:26.040882904 +0000 UTC m=+304.980850165" Jul 22 01:52:26.186842 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:26.186813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:27.408318 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:27.408287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:29.378082 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:29.378044 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:29.478201 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:29.478168 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:31.680107 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:31.680076 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:32.032688 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:32.032615 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wqqwp" Jul 22 01:52:43.618404 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:43.618366 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:43.712706 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:43.712675 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:49.634063 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:49.634033 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:49.704132 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:49.704104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:51.537829 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:51.537794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:52:52.483002 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.482969 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6"] Jul 22 01:52:52.486439 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.486423 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.488828 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.488804 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 01:52:52.489644 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.489628 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 01:52:52.489750 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.489678 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmb4g\"" Jul 22 01:52:52.495158 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.495136 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6"] Jul 22 01:52:52.518039 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.518009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.518172 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.518046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.518172 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.518068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhtj\" (UniqueName: \"kubernetes.io/projected/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-kube-api-access-rfhtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.618601 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.618563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.618601 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.618606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.619023 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.618627 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhtj\" (UniqueName: \"kubernetes.io/projected/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-kube-api-access-rfhtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.619023 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.618945 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.619023 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.618975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.626792 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.626767 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhtj\" (UniqueName: \"kubernetes.io/projected/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-kube-api-access-rfhtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.797141 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.797045 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:52.931584 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:52.931446 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6"] Jul 22 01:52:52.934346 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:52:52.934315 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f183e3f_3e4f_44a6_b4f2_65aa91642e80.slice/crio-cd9660ed3a47321e19ca4baa8e04ca17edb8c1befa3ab284f6d6daa38b582ad6 WatchSource:0}: Error finding container cd9660ed3a47321e19ca4baa8e04ca17edb8c1befa3ab284f6d6daa38b582ad6: Status 404 returned error can't find the container with id cd9660ed3a47321e19ca4baa8e04ca17edb8c1befa3ab284f6d6daa38b582ad6 Jul 22 01:52:53.135690 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:53.135597 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerID="bad55e6216d55892ae38617a7df12fdceba2ca846429035ee7383fe939acaeeb" exitCode=0 Jul 22 01:52:53.135831 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:53.135685 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" event={"ID":"7f183e3f-3e4f-44a6-b4f2-65aa91642e80","Type":"ContainerDied","Data":"bad55e6216d55892ae38617a7df12fdceba2ca846429035ee7383fe939acaeeb"} Jul 22 01:52:53.135831 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:53.135731 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" event={"ID":"7f183e3f-3e4f-44a6-b4f2-65aa91642e80","Type":"ContainerStarted","Data":"cd9660ed3a47321e19ca4baa8e04ca17edb8c1befa3ab284f6d6daa38b582ad6"} Jul 22 01:52:54.141180 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:54.141146 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerID="020461f1eb4646973149b322e17ed469336e418522512bd4b2d772847b87bbe2" exitCode=0 Jul 22 01:52:54.141572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:54.141196 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" event={"ID":"7f183e3f-3e4f-44a6-b4f2-65aa91642e80","Type":"ContainerDied","Data":"020461f1eb4646973149b322e17ed469336e418522512bd4b2d772847b87bbe2"} Jul 22 01:52:55.152384 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:55.152350 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerID="850d9465e82320c3411ecb4bcd79dcf3f665497e7986f3f2553b7e2335c300ef" exitCode=0 Jul 22 01:52:55.152825 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:55.152400 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" event={"ID":"7f183e3f-3e4f-44a6-b4f2-65aa91642e80","Type":"ContainerDied","Data":"850d9465e82320c3411ecb4bcd79dcf3f665497e7986f3f2553b7e2335c300ef"} Jul 22 01:52:56.290539 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.290498 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:56.350165 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.350134 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-bundle\") pod \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " Jul 22 01:52:56.350343 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.350183 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-util\") pod \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " Jul 22 01:52:56.350343 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.350226 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfhtj\" (UniqueName: \"kubernetes.io/projected/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-kube-api-access-rfhtj\") pod \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\" (UID: \"7f183e3f-3e4f-44a6-b4f2-65aa91642e80\") " Jul 22 01:52:56.350910 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.350867 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-bundle" (OuterVolumeSpecName: "bundle") pod "7f183e3f-3e4f-44a6-b4f2-65aa91642e80" (UID: "7f183e3f-3e4f-44a6-b4f2-65aa91642e80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:52:56.352423 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.352403 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-kube-api-access-rfhtj" (OuterVolumeSpecName: "kube-api-access-rfhtj") pod "7f183e3f-3e4f-44a6-b4f2-65aa91642e80" (UID: "7f183e3f-3e4f-44a6-b4f2-65aa91642e80"). InnerVolumeSpecName "kube-api-access-rfhtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:52:56.355626 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.355603 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-util" (OuterVolumeSpecName: "util") pod "7f183e3f-3e4f-44a6-b4f2-65aa91642e80" (UID: "7f183e3f-3e4f-44a6-b4f2-65aa91642e80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 01:52:56.451208 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.451176 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:52:56.451208 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.451202 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-util\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:52:56.451208 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:56.451212 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfhtj\" (UniqueName: \"kubernetes.io/projected/7f183e3f-3e4f-44a6-b4f2-65aa91642e80-kube-api-access-rfhtj\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:52:57.162884 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:57.162849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" event={"ID":"7f183e3f-3e4f-44a6-b4f2-65aa91642e80","Type":"ContainerDied","Data":"cd9660ed3a47321e19ca4baa8e04ca17edb8c1befa3ab284f6d6daa38b582ad6"} Jul 22 01:52:57.163050 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:57.162897 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd9660ed3a47321e19ca4baa8e04ca17edb8c1befa3ab284f6d6daa38b582ad6" Jul 22 01:52:57.163050 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:57.162859 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8qpn6" Jul 22 01:52:57.340520 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:52:57.340477 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:03.819230 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:03.819192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:03.918618 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:03.918587 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:04.415789 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.415752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:04.612138 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.612102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:04.702000 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.701911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:04.724162 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724125 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm"] Jul 22 01:53:04.724550 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724531 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="extract" Jul 22 01:53:04.724653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724552 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="extract" Jul 22 01:53:04.724653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724571 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="pull" Jul 22 01:53:04.724653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724579 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="pull" Jul 22 01:53:04.724653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724594 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="util" Jul 22 01:53:04.724653 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724605 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="util" Jul 22 01:53:04.724887 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.724705 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f183e3f-3e4f-44a6-b4f2-65aa91642e80" containerName="extract" Jul 22 01:53:04.727939 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.727919 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.730437 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.730418 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 01:53:04.730580 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.730560 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 01:53:04.730748 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.730733 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 01:53:04.730807 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.730764 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 01:53:04.730855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.730836 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5gsh8\"" Jul 22 01:53:04.747257 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.747231 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm"] Jul 22 01:53:04.818928 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.818894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zng54\" (UniqueName: \"kubernetes.io/projected/7da8827e-d16d-447e-bec1-03cd59fffb2b-kube-api-access-zng54\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.819086 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.818941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7da8827e-d16d-447e-bec1-03cd59fffb2b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.819086 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.818966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7da8827e-d16d-447e-bec1-03cd59fffb2b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.819086 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.818986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da8827e-d16d-447e-bec1-03cd59fffb2b-tmp\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.819086 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.819011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7da8827e-d16d-447e-bec1-03cd59fffb2b-manifests\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.862596 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.862568 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:04.919982 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.919948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7da8827e-d16d-447e-bec1-03cd59fffb2b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.919982 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.919987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7da8827e-d16d-447e-bec1-03cd59fffb2b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.920176 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.920008 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da8827e-d16d-447e-bec1-03cd59fffb2b-tmp\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.920176 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.920054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7da8827e-d16d-447e-bec1-03cd59fffb2b-manifests\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.920176 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.920128 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zng54\" (UniqueName: \"kubernetes.io/projected/7da8827e-d16d-447e-bec1-03cd59fffb2b-kube-api-access-zng54\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.920570 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.920534 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7da8827e-d16d-447e-bec1-03cd59fffb2b-manifests\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.922348 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.922321 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da8827e-d16d-447e-bec1-03cd59fffb2b-tmp\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.922586 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.922568 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7da8827e-d16d-447e-bec1-03cd59fffb2b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.922696 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.922676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7da8827e-d16d-447e-bec1-03cd59fffb2b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.939844 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.939816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zng54\" (UniqueName: \"kubernetes.io/projected/7da8827e-d16d-447e-bec1-03cd59fffb2b-kube-api-access-zng54\") pod \"opendatahub-operator-controller-manager-76db4bc599-9bccm\" (UID: \"7da8827e-d16d-447e-bec1-03cd59fffb2b\") " pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:04.969829 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:04.969757 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:05.038047 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:05.038009 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:05.073992 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:05.073958 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:05.170741 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:05.170711 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:05.176605 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:05.176582 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm"] Jul 22 01:53:05.179786 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:53:05.179765 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da8827e_d16d_447e_bec1_03cd59fffb2b.slice/crio-367d466b0188a1d55ba77f7562af3d0de1fc56ff2c9a32b2148fcee4b6f53472 WatchSource:0}: Error finding container 367d466b0188a1d55ba77f7562af3d0de1fc56ff2c9a32b2148fcee4b6f53472: Status 404 returned error can't find the container with id 367d466b0188a1d55ba77f7562af3d0de1fc56ff2c9a32b2148fcee4b6f53472 Jul 22 01:53:05.198916 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:05.198890 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" event={"ID":"7da8827e-d16d-447e-bec1-03cd59fffb2b","Type":"ContainerStarted","Data":"367d466b0188a1d55ba77f7562af3d0de1fc56ff2c9a32b2148fcee4b6f53472"} Jul 22 01:53:05.275387 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:05.275304 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:08.214540 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:08.214492 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" event={"ID":"7da8827e-d16d-447e-bec1-03cd59fffb2b","Type":"ContainerStarted","Data":"df4bd9f3b74c3985570f8fe94e3b7c7ad8352896f78b8709cdfba5517455f346"} Jul 22 01:53:09.784142 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:09.784109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:09.893405 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:09.893375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:10.224437 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:10.224397 2554 generic.go:356] "Generic (PLEG): container finished" podID="7da8827e-d16d-447e-bec1-03cd59fffb2b" containerID="df4bd9f3b74c3985570f8fe94e3b7c7ad8352896f78b8709cdfba5517455f346" exitCode=0 Jul 22 01:53:10.224612 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:10.224470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" event={"ID":"7da8827e-d16d-447e-bec1-03cd59fffb2b","Type":"ContainerDied","Data":"df4bd9f3b74c3985570f8fe94e3b7c7ad8352896f78b8709cdfba5517455f346"} Jul 22 01:53:11.230866 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:11.230831 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" event={"ID":"7da8827e-d16d-447e-bec1-03cd59fffb2b","Type":"ContainerStarted","Data":"20df97611ed5a6117c3c02280c262d22bc893b9467db042425fb972ffa1da1f7"} Jul 22 01:53:11.231341 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:11.231060 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:11.252369 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:11.252317 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" podStartSLOduration=2.789201523 podStartE2EDuration="7.252301794s" totalImagesPullingTime="3.374856324s" totalInitContainerRuntime="1.088243947s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:11.250161721 +0000 UTC m=+350.190128982" watchObservedRunningTime="2026-07-22 01:53:11.252301794 +0000 UTC m=+350.192269129" Jul 22 01:53:22.237432 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:22.237359 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76db4bc599-9bccm" Jul 22 01:53:24.282410 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.282377 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:24.372864 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.372828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:24.412218 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.412171 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7"] Jul 22 01:53:24.420465 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.420428 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.422751 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.422731 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 01:53:24.422871 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.422780 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 01:53:24.423491 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.423472 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 01:53:24.423603 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.423497 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 01:53:24.423603 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.423590 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jvxbk\"" Jul 22 01:53:24.423705 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.423689 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 01:53:24.430072 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.430047 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7"] Jul 22 01:53:24.491573 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.491523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b0cc1cf-da74-484b-bd3d-714ace87398e-manager-config\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.491751 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.491581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0cc1cf-da74-484b-bd3d-714ace87398e-cert\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.491751 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.491615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b0cc1cf-da74-484b-bd3d-714ace87398e-metrics-cert\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.491751 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.491657 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c52j4\" (UniqueName: \"kubernetes.io/projected/2b0cc1cf-da74-484b-bd3d-714ace87398e-kube-api-access-c52j4\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.592650 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.592559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c52j4\" (UniqueName: \"kubernetes.io/projected/2b0cc1cf-da74-484b-bd3d-714ace87398e-kube-api-access-c52j4\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.592650 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.592643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b0cc1cf-da74-484b-bd3d-714ace87398e-manager-config\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.592885 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.592665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0cc1cf-da74-484b-bd3d-714ace87398e-cert\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.592885 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.592698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b0cc1cf-da74-484b-bd3d-714ace87398e-metrics-cert\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.593559 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.593453 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b0cc1cf-da74-484b-bd3d-714ace87398e-manager-config\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.595595 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.595567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b0cc1cf-da74-484b-bd3d-714ace87398e-metrics-cert\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.595727 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.595694 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b0cc1cf-da74-484b-bd3d-714ace87398e-cert\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.601106 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.601081 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c52j4\" (UniqueName: \"kubernetes.io/projected/2b0cc1cf-da74-484b-bd3d-714ace87398e-kube-api-access-c52j4\") pod \"lws-controller-manager-54d5765bf5-7kgl7\" (UID: \"2b0cc1cf-da74-484b-bd3d-714ace87398e\") " pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.729861 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.729796 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:24.805854 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.805822 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:24.887238 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:24.887214 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7"] Jul 22 01:53:24.889089 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:53:24.889064 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0cc1cf_da74_484b_bd3d_714ace87398e.slice/crio-9d05b0d71fe3748f1fedd17f5e3fbe7d62e2a2e8d67554c15678502d426892ce WatchSource:0}: Error finding container 9d05b0d71fe3748f1fedd17f5e3fbe7d62e2a2e8d67554c15678502d426892ce: Status 404 returned error can't find the container with id 9d05b0d71fe3748f1fedd17f5e3fbe7d62e2a2e8d67554c15678502d426892ce Jul 22 01:53:25.040090 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.040027 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:25.116713 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.116668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:25.187264 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.187234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:25.282288 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.282260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:25.291209 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.291178 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" event={"ID":"2b0cc1cf-da74-484b-bd3d-714ace87398e","Type":"ContainerStarted","Data":"9d05b0d71fe3748f1fedd17f5e3fbe7d62e2a2e8d67554c15678502d426892ce"} Jul 22 01:53:25.383990 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.383960 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:25.622598 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:25.622459 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:26.019131 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.019036 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:26.077055 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.077019 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6w8qc"] Jul 22 01:53:26.080735 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.080712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.083113 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.083087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bgw96\"" Jul 22 01:53:26.083226 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.083178 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 22 01:53:26.091635 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.091571 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6w8qc"] Jul 22 01:53:26.207855 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.207817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99bc3c58-35d8-44f7-99a5-c8d7add2e286-tls-certs\") pod \"model-serving-api-54d89bd5fc-6w8qc\" (UID: \"99bc3c58-35d8-44f7-99a5-c8d7add2e286\") " pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.208048 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.207956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rqs\" (UniqueName: \"kubernetes.io/projected/99bc3c58-35d8-44f7-99a5-c8d7add2e286-kube-api-access-28rqs\") pod \"model-serving-api-54d89bd5fc-6w8qc\" (UID: \"99bc3c58-35d8-44f7-99a5-c8d7add2e286\") " pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.308661 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.308577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rqs\" (UniqueName: \"kubernetes.io/projected/99bc3c58-35d8-44f7-99a5-c8d7add2e286-kube-api-access-28rqs\") pod \"model-serving-api-54d89bd5fc-6w8qc\" (UID: \"99bc3c58-35d8-44f7-99a5-c8d7add2e286\") " pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.308661 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.308642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99bc3c58-35d8-44f7-99a5-c8d7add2e286-tls-certs\") pod \"model-serving-api-54d89bd5fc-6w8qc\" (UID: \"99bc3c58-35d8-44f7-99a5-c8d7add2e286\") " pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.311949 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.311908 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99bc3c58-35d8-44f7-99a5-c8d7add2e286-tls-certs\") pod \"model-serving-api-54d89bd5fc-6w8qc\" (UID: \"99bc3c58-35d8-44f7-99a5-c8d7add2e286\") " pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.320873 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.320850 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rqs\" (UniqueName: \"kubernetes.io/projected/99bc3c58-35d8-44f7-99a5-c8d7add2e286-kube-api-access-28rqs\") pod \"model-serving-api-54d89bd5fc-6w8qc\" (UID: \"99bc3c58-35d8-44f7-99a5-c8d7add2e286\") " pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.394413 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.394380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:26.528458 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.528420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:26.596559 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:26.596468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:27.065272 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:27.065193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:27.476639 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:27.476443 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6w8qc"] Jul 22 01:53:27.479117 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:53:27.479095 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bc3c58_35d8_44f7_99a5_c8d7add2e286.slice/crio-3981aebfea850883a28ab908d61ae07e39f40a7d8f1e2a5091a07bb7c05235ee WatchSource:0}: Error finding container 3981aebfea850883a28ab908d61ae07e39f40a7d8f1e2a5091a07bb7c05235ee: Status 404 returned error can't find the container with id 3981aebfea850883a28ab908d61ae07e39f40a7d8f1e2a5091a07bb7c05235ee Jul 22 01:53:28.313295 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:28.313256 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" event={"ID":"99bc3c58-35d8-44f7-99a5-c8d7add2e286","Type":"ContainerStarted","Data":"3981aebfea850883a28ab908d61ae07e39f40a7d8f1e2a5091a07bb7c05235ee"} Jul 22 01:53:28.314685 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:28.314664 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" event={"ID":"2b0cc1cf-da74-484b-bd3d-714ace87398e","Type":"ContainerStarted","Data":"f9349161dca0da41a4b3d47cbdc560454652672f4da2eb9d8e79772daa09d076"} Jul 22 01:53:28.314799 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:28.314727 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:28.334429 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:28.334385 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" podStartSLOduration=1.8229074189999999 podStartE2EDuration="4.334371327s" totalImagesPullingTime="2.511463908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:28.332951554 +0000 UTC m=+367.272918815" watchObservedRunningTime="2026-07-22 01:53:28.334371327 +0000 UTC m=+367.274338589" Jul 22 01:53:29.320923 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:29.320820 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" event={"ID":"99bc3c58-35d8-44f7-99a5-c8d7add2e286","Type":"ContainerStarted","Data":"23bfc0b5d8c7bc3e0a3e2bdec38bc0c21c46bf86964e0b360ba2d8817f8155bb"} Jul 22 01:53:29.321348 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:29.321032 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:29.337710 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:29.337660 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" podStartSLOduration=1.787810481 podStartE2EDuration="3.337640919s" totalImagesPullingTime="1.549830438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:29.337473388 +0000 UTC m=+368.277440650" watchObservedRunningTime="2026-07-22 01:53:29.337640919 +0000 UTC m=+368.277608180" Jul 22 01:53:30.861576 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:30.861544 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:30.959169 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:30.959133 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:31.505091 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.505049 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q"] Jul 22 01:53:31.508568 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.508536 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.511164 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.511132 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 01:53:31.511318 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.511190 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-plpxq\"" Jul 22 01:53:31.521346 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.521321 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q"] Jul 22 01:53:31.538138 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.538102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:31.654743 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654743 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654743 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654979 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9sdf\" (UniqueName: \"kubernetes.io/projected/4322b333-4774-4d0a-900d-49555f2916be-kube-api-access-r9sdf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654979 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4322b333-4774-4d0a-900d-49555f2916be-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654979 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654820 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4322b333-4774-4d0a-900d-49555f2916be-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654979 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654979 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.654979 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.655163 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.654997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4322b333-4774-4d0a-900d-49555f2916be-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755482 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755482 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755418 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755482 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755482 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4322b333-4774-4d0a-900d-49555f2916be-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755810 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755526 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755810 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755549 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755810 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9sdf\" (UniqueName: \"kubernetes.io/projected/4322b333-4774-4d0a-900d-49555f2916be-kube-api-access-r9sdf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755810 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4322b333-4774-4d0a-900d-49555f2916be-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.755810 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4322b333-4774-4d0a-900d-49555f2916be-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.756063 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.756063 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755927 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.756063 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.755985 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.756222 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.756068 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.756315 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.756296 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4322b333-4774-4d0a-900d-49555f2916be-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.758051 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.758023 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4322b333-4774-4d0a-900d-49555f2916be-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.758251 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.758230 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4322b333-4774-4d0a-900d-49555f2916be-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.763218 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.763191 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9sdf\" (UniqueName: \"kubernetes.io/projected/4322b333-4774-4d0a-900d-49555f2916be-kube-api-access-r9sdf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.763639 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.763619 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4322b333-4774-4d0a-900d-49555f2916be-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4cgn2q\" (UID: \"4322b333-4774-4d0a-900d-49555f2916be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.819328 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.819294 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:31.970343 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:31.970195 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q"] Jul 22 01:53:31.972657 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:53:31.972628 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4322b333_4774_4d0a_900d_49555f2916be.slice/crio-cbcb8452162f0f7c625479b165224766da37e3545e4016e0a81542608a8f3d10 WatchSource:0}: Error finding container cbcb8452162f0f7c625479b165224766da37e3545e4016e0a81542608a8f3d10: Status 404 returned error can't find the container with id cbcb8452162f0f7c625479b165224766da37e3545e4016e0a81542608a8f3d10 Jul 22 01:53:32.118298 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:32.118192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:32.217489 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:32.217451 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:32.338182 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:32.338143 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" event={"ID":"4322b333-4774-4d0a-900d-49555f2916be","Type":"ContainerStarted","Data":"cbcb8452162f0f7c625479b165224766da37e3545e4016e0a81542608a8f3d10"} Jul 22 01:53:33.472424 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.472390 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn"] Jul 22 01:53:33.476092 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.476065 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.478539 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.478497 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 01:53:33.478539 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.478533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 01:53:33.478719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.478551 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-54tjd\"" Jul 22 01:53:33.478719 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.478533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 01:53:33.487858 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.487833 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn"] Jul 22 01:53:33.572531 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scmk4\" (UniqueName: \"kubernetes.io/projected/0ec17ba8-4a4d-47da-a57d-540962ada1d8-kube-api-access-scmk4\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.572771 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.572771 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec17ba8-4a4d-47da-a57d-540962ada1d8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.572771 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.572771 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.572771 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.572771 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.572770 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.673763 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.673763 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.674026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scmk4\" (UniqueName: \"kubernetes.io/projected/0ec17ba8-4a4d-47da-a57d-540962ada1d8-kube-api-access-scmk4\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.674026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673822 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.674026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673840 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec17ba8-4a4d-47da-a57d-540962ada1d8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.674026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.674026 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.673910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.674810 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.674782 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.676317 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.676292 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.676746 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.676695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec17ba8-4a4d-47da-a57d-540962ada1d8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.676905 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.676878 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.677052 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.676939 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.683924 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.683899 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec17ba8-4a4d-47da-a57d-540962ada1d8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.684095 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.684076 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scmk4\" (UniqueName: \"kubernetes.io/projected/0ec17ba8-4a4d-47da-a57d-540962ada1d8-kube-api-access-scmk4\") pod \"istiod-openshift-gateway-94bb8fbfd-t22gn\" (UID: \"0ec17ba8-4a4d-47da-a57d-540962ada1d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.786368 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.786270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:33.941188 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:33.941164 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn"] Jul 22 01:53:33.943792 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:53:33.943765 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec17ba8_4a4d_47da_a57d_540962ada1d8.slice/crio-6d645bb522b2b6d8ec1f6265fd9377a13773ad57adc26a295b76d51bb626ce6b WatchSource:0}: Error finding container 6d645bb522b2b6d8ec1f6265fd9377a13773ad57adc26a295b76d51bb626ce6b: Status 404 returned error can't find the container with id 6d645bb522b2b6d8ec1f6265fd9377a13773ad57adc26a295b76d51bb626ce6b Jul 22 01:53:34.349324 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:34.349278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" event={"ID":"0ec17ba8-4a4d-47da-a57d-540962ada1d8","Type":"ContainerStarted","Data":"6d645bb522b2b6d8ec1f6265fd9377a13773ad57adc26a295b76d51bb626ce6b"} Jul 22 01:53:35.935712 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:35.935656 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:36.026135 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:36.026104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:36.184356 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:36.184324 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:36.325034 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:36.324952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:36.426671 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:36.426593 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:36.780466 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:36.780428 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:36.934152 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:36.934121 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:53:37.096415 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:37.096376 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:53:37.096761 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:37.096452 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:53:37.096761 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:37.096490 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:53:37.365488 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:37.365395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" event={"ID":"4322b333-4774-4d0a-900d-49555f2916be","Type":"ContainerStarted","Data":"61ca84a9435b1e57b832af5461a5dcb81b84d63d283398fbe7b0805a9d20d598"} Jul 22 01:53:37.411781 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:37.411728 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" podStartSLOduration=1.290467259 podStartE2EDuration="6.411710562s" totalImagesPullingTime="5.121243303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:37.409912943 +0000 UTC m=+376.349880193" watchObservedRunningTime="2026-07-22 01:53:37.411710562 +0000 UTC m=+376.351677823" Jul 22 01:53:37.820212 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:37.820174 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:38.826058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:38.826027 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:39.323951 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:39.323923 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54d5765bf5-7kgl7" Jul 22 01:53:39.374862 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:39.374835 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:39.376022 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:39.376000 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4cgn2q" Jul 22 01:53:39.425667 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:39.425621 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:53:39.425780 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:39.425693 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 01:53:40.329327 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:40.329300 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6w8qc" Jul 22 01:53:40.380471 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:40.380436 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" event={"ID":"0ec17ba8-4a4d-47da-a57d-540962ada1d8","Type":"ContainerStarted","Data":"294fba26be7b96522b899838f05e9fdfadb0e53b3c07f3a11aa4b35f0981cd96"} Jul 22 01:53:40.380696 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:40.380676 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:40.382281 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:40.382258 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" Jul 22 01:53:40.399467 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:40.399424 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t22gn" podStartSLOduration=1.919980456 podStartE2EDuration="7.399409409s" totalImagesPullingTime="5.479428953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:53:40.397885853 +0000 UTC m=+379.337853114" watchObservedRunningTime="2026-07-22 01:53:40.399409409 +0000 UTC m=+379.339376670" Jul 22 01:53:49.318733 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:53:49.318692 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:25.841306 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:25.841271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:25.936874 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:25.936844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:26.035954 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:26.035920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:26.786002 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:26.785971 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:26.990634 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:26.990581 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:49.510048 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:49.510014 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:52.951170 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:52.951120 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:54.955316 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:54.955279 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:56.511585 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:56.511492 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:56.903938 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:56.903812 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:58.344655 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:58.344615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:54:59.916728 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:54:59.916691 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:00.831404 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:00.831371 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:00.938892 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:00.938860 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:02.819847 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:02.819815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:02.956041 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:02.956015 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:03.212660 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:03.212627 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:04.523754 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:04.523675 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:04.624489 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:04.624453 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:12.232467 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:12.232434 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:12.342277 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:12.342245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:16.958098 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:16.958061 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:17.066220 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:17.066187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:19.375374 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:19.375340 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:19.442457 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:19.442422 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:24.919029 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:24.918997 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:24.975566 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:24.975529 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:25.265676 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:25.265603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:25.398224 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:25.398196 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:26.717200 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:26.717167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:26.778212 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:26.778178 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:31.774635 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:31.774603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:31.875996 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:31.875965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:36.592250 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:36.592216 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:36.691519 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:36.691484 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:39.029037 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:39.028996 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:39.125751 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:39.125715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:42.192563 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:42.192502 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:42.401587 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:42.401558 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:44.782273 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:44.782239 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:44.841610 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:44.841578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:47.344120 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:47.344079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:47.532100 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:47.532070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:47.601468 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:47.601392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:48.188274 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:48.188244 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:48.289362 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:48.289326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:52.182812 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:52.182780 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:52.282624 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:52.282593 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:56.882787 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:56.882759 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:56.987406 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:56.987374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:59.249343 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:59.249311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:55:59.352484 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:55:59.352451 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:03.605761 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:03.605726 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:03.720840 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:03.720808 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:04.166996 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:04.166966 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:06.187079 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:06.187045 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:06.272947 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:06.272914 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.321718 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:16.321642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:16.671827 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:16.671799 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:24.107227 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.107189 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-566749c4f6-pm5cf"] Jul 22 01:56:24.110389 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.110373 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.113157 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.113133 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 01:56:24.113278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.113245 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 01:56:24.113343 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.113279 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n8jqz\"" Jul 22 01:56:24.122059 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.122026 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-566749c4f6-pm5cf"] Jul 22 01:56:24.223947 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.223912 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hghn\" (UniqueName: \"kubernetes.io/projected/dcec1f4d-bd4e-4c63-b903-010f4498351e-kube-api-access-7hghn\") pod \"maas-controller-566749c4f6-pm5cf\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.223947 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.223949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcec1f4d-bd4e-4c63-b903-010f4498351e-webhook-cert\") pod \"maas-controller-566749c4f6-pm5cf\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.279079 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.279046 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bjx2q"] Jul 22 01:56:24.282304 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.282288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.290880 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.290855 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bjx2q"] Jul 22 01:56:24.322741 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.322711 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:24.324826 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.324803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hghn\" (UniqueName: \"kubernetes.io/projected/dcec1f4d-bd4e-4c63-b903-010f4498351e-kube-api-access-7hghn\") pod \"maas-controller-566749c4f6-pm5cf\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.324882 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.324837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcec1f4d-bd4e-4c63-b903-010f4498351e-webhook-cert\") pod \"maas-controller-566749c4f6-pm5cf\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.327333 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.327306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcec1f4d-bd4e-4c63-b903-010f4498351e-webhook-cert\") pod \"maas-controller-566749c4f6-pm5cf\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.337193 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.337166 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hghn\" (UniqueName: \"kubernetes.io/projected/dcec1f4d-bd4e-4c63-b903-010f4498351e-kube-api-access-7hghn\") pod \"maas-controller-566749c4f6-pm5cf\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.388053 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.387984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:24.423190 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.423161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:24.425581 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.425556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl7m2\" (UniqueName: \"kubernetes.io/projected/aa206478-dfe5-459b-8c00-50aa3230be64-kube-api-access-dl7m2\") pod \"maas-controller-7db775cb8b-bjx2q\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.425697 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.425596 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa206478-dfe5-459b-8c00-50aa3230be64-webhook-cert\") pod \"maas-controller-7db775cb8b-bjx2q\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.526461 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.526035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl7m2\" (UniqueName: \"kubernetes.io/projected/aa206478-dfe5-459b-8c00-50aa3230be64-kube-api-access-dl7m2\") pod \"maas-controller-7db775cb8b-bjx2q\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.526461 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.526086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa206478-dfe5-459b-8c00-50aa3230be64-webhook-cert\") pod \"maas-controller-7db775cb8b-bjx2q\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.529017 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.528994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa206478-dfe5-459b-8c00-50aa3230be64-webhook-cert\") pod \"maas-controller-7db775cb8b-bjx2q\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.534492 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.534463 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl7m2\" (UniqueName: \"kubernetes.io/projected/aa206478-dfe5-459b-8c00-50aa3230be64-kube-api-access-dl7m2\") pod \"maas-controller-7db775cb8b-bjx2q\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.557915 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.557889 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-566749c4f6-pm5cf"] Jul 22 01:56:24.559913 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:56:24.559886 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcec1f4d_bd4e_4c63_b903_010f4498351e.slice/crio-8ac18c8deab6cd44a37b5e4cc912ccdb113d5668df03d2627131a7cbb3efa660 WatchSource:0}: Error finding container 8ac18c8deab6cd44a37b5e4cc912ccdb113d5668df03d2627131a7cbb3efa660: Status 404 returned error can't find the container with id 8ac18c8deab6cd44a37b5e4cc912ccdb113d5668df03d2627131a7cbb3efa660 Jul 22 01:56:24.593052 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.593027 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:24.724595 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:24.724531 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bjx2q"] Jul 22 01:56:24.726781 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:56:24.726755 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa206478_dfe5_459b_8c00_50aa3230be64.slice/crio-31d11a89503983fcc020f46c6a51c453113ce8a6cdc760ed690cbfb9e4da91c6 WatchSource:0}: Error finding container 31d11a89503983fcc020f46c6a51c453113ce8a6cdc760ed690cbfb9e4da91c6: Status 404 returned error can't find the container with id 31d11a89503983fcc020f46c6a51c453113ce8a6cdc760ed690cbfb9e4da91c6 Jul 22 01:56:25.116580 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:25.116547 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" event={"ID":"aa206478-dfe5-459b-8c00-50aa3230be64","Type":"ContainerStarted","Data":"31d11a89503983fcc020f46c6a51c453113ce8a6cdc760ed690cbfb9e4da91c6"} Jul 22 01:56:25.117612 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:25.117582 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566749c4f6-pm5cf" event={"ID":"dcec1f4d-bd4e-4c63-b903-010f4498351e","Type":"ContainerStarted","Data":"8ac18c8deab6cd44a37b5e4cc912ccdb113d5668df03d2627131a7cbb3efa660"} Jul 22 01:56:25.940716 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:25.940681 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:27.411067 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:27.411037 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:27.512797 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:27.512695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:28.136439 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:28.136405 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566749c4f6-pm5cf" event={"ID":"dcec1f4d-bd4e-4c63-b903-010f4498351e","Type":"ContainerStarted","Data":"2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1"} Jul 22 01:56:28.136755 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:28.136540 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:28.137927 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:28.137905 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" event={"ID":"aa206478-dfe5-459b-8c00-50aa3230be64","Type":"ContainerStarted","Data":"d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711"} Jul 22 01:56:28.138033 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:28.138019 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:28.154969 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:28.154926 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-566749c4f6-pm5cf" podStartSLOduration=1.46378863 podStartE2EDuration="4.154912416s" totalImagesPullingTime="2.691123786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:56:28.152693941 +0000 UTC m=+547.092661201" watchObservedRunningTime="2026-07-22 01:56:28.154912416 +0000 UTC m=+547.094879676" Jul 22 01:56:28.169006 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:28.168958 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" podStartSLOduration=1.651863026 podStartE2EDuration="4.168941094s" totalImagesPullingTime="2.517078068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:56:28.168189172 +0000 UTC m=+547.108156433" watchObservedRunningTime="2026-07-22 01:56:28.168941094 +0000 UTC m=+547.108908356" Jul 22 01:56:39.144043 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.144007 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:56:39.144421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.144103 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:39.204481 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.204451 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-566749c4f6-pm5cf"] Jul 22 01:56:39.204735 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.204707 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-566749c4f6-pm5cf" podUID="dcec1f4d-bd4e-4c63-b903-010f4498351e" containerName="manager" containerID="cri-o://2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1" gracePeriod=30 Jul 22 01:56:39.452957 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.452931 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:39.555379 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.555347 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hghn\" (UniqueName: \"kubernetes.io/projected/dcec1f4d-bd4e-4c63-b903-010f4498351e-kube-api-access-7hghn\") pod \"dcec1f4d-bd4e-4c63-b903-010f4498351e\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " Jul 22 01:56:39.555379 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.555384 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcec1f4d-bd4e-4c63-b903-010f4498351e-webhook-cert\") pod \"dcec1f4d-bd4e-4c63-b903-010f4498351e\" (UID: \"dcec1f4d-bd4e-4c63-b903-010f4498351e\") " Jul 22 01:56:39.557872 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.557840 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcec1f4d-bd4e-4c63-b903-010f4498351e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dcec1f4d-bd4e-4c63-b903-010f4498351e" (UID: "dcec1f4d-bd4e-4c63-b903-010f4498351e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:56:39.557990 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.557877 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcec1f4d-bd4e-4c63-b903-010f4498351e-kube-api-access-7hghn" (OuterVolumeSpecName: "kube-api-access-7hghn") pod "dcec1f4d-bd4e-4c63-b903-010f4498351e" (UID: "dcec1f4d-bd4e-4c63-b903-010f4498351e"). InnerVolumeSpecName "kube-api-access-7hghn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:56:39.656609 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.656569 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hghn\" (UniqueName: \"kubernetes.io/projected/dcec1f4d-bd4e-4c63-b903-010f4498351e-kube-api-access-7hghn\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:56:39.656609 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:39.656599 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dcec1f4d-bd4e-4c63-b903-010f4498351e-webhook-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:56:40.201057 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.201025 2554 generic.go:356] "Generic (PLEG): container finished" podID="dcec1f4d-bd4e-4c63-b903-010f4498351e" containerID="2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1" exitCode=0 Jul 22 01:56:40.201546 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.201068 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566749c4f6-pm5cf" Jul 22 01:56:40.201546 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.201076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566749c4f6-pm5cf" event={"ID":"dcec1f4d-bd4e-4c63-b903-010f4498351e","Type":"ContainerDied","Data":"2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1"} Jul 22 01:56:40.201546 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.201118 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566749c4f6-pm5cf" event={"ID":"dcec1f4d-bd4e-4c63-b903-010f4498351e","Type":"ContainerDied","Data":"8ac18c8deab6cd44a37b5e4cc912ccdb113d5668df03d2627131a7cbb3efa660"} Jul 22 01:56:40.201546 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.201139 2554 scope.go:117] "RemoveContainer" containerID="2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1" Jul 22 01:56:40.209962 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.209807 2554 scope.go:117] "RemoveContainer" containerID="2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1" Jul 22 01:56:40.210157 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:56:40.210139 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1\": container with ID starting with 2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1 not found: ID does not exist" containerID="2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1" Jul 22 01:56:40.210209 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.210166 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1"} err="failed to get container status \"2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1\": rpc error: code = NotFound desc = could not find container \"2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1\": container with ID starting with 2f805532c788f0836955878fd270cfa362b4a3588bcdadea4cb0f1d98e76dfc1 not found: ID does not exist" Jul 22 01:56:40.217655 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.217625 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-566749c4f6-pm5cf"] Jul 22 01:56:40.221378 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:40.221356 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-566749c4f6-pm5cf"] Jul 22 01:56:41.564359 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:41.564326 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcec1f4d-bd4e-4c63-b903-010f4498351e" path="/var/lib/kubelet/pods/dcec1f4d-bd4e-4c63-b903-010f4498351e/volumes" Jul 22 01:56:58.503093 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:58.503044 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:58.592858 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:58.592823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:59.060217 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.060187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:59.287952 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.287913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:59.487178 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.487142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:59.595263 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.595228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:56:59.596496 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.596472 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-tqmbd"] Jul 22 01:56:59.596875 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.596858 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcec1f4d-bd4e-4c63-b903-010f4498351e" containerName="manager" Jul 22 01:56:59.596947 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.596878 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcec1f4d-bd4e-4c63-b903-010f4498351e" containerName="manager" Jul 22 01:56:59.597004 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.596979 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcec1f4d-bd4e-4c63-b903-010f4498351e" containerName="manager" Jul 22 01:56:59.600045 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.600018 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.602447 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.602429 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sgtnk\"" Jul 22 01:56:59.602555 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.602429 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 01:56:59.617639 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.617609 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-tqmbd"] Jul 22 01:56:59.731105 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.731075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frxwf\" (UniqueName: \"kubernetes.io/projected/742fb4d8-ced1-4e81-a4fe-af70acd8a987-kube-api-access-frxwf\") pod \"payload-pre-processing-7677b774bb-tqmbd\" (UID: \"742fb4d8-ced1-4e81-a4fe-af70acd8a987\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.731308 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.731134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/742fb4d8-ced1-4e81-a4fe-af70acd8a987-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-tqmbd\" (UID: \"742fb4d8-ced1-4e81-a4fe-af70acd8a987\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.832362 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.832263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/742fb4d8-ced1-4e81-a4fe-af70acd8a987-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-tqmbd\" (UID: \"742fb4d8-ced1-4e81-a4fe-af70acd8a987\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.832530 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.832358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frxwf\" (UniqueName: \"kubernetes.io/projected/742fb4d8-ced1-4e81-a4fe-af70acd8a987-kube-api-access-frxwf\") pod \"payload-pre-processing-7677b774bb-tqmbd\" (UID: \"742fb4d8-ced1-4e81-a4fe-af70acd8a987\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.833006 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.832980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/742fb4d8-ced1-4e81-a4fe-af70acd8a987-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-tqmbd\" (UID: \"742fb4d8-ced1-4e81-a4fe-af70acd8a987\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.853433 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.853405 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frxwf\" (UniqueName: \"kubernetes.io/projected/742fb4d8-ced1-4e81-a4fe-af70acd8a987-kube-api-access-frxwf\") pod \"payload-pre-processing-7677b774bb-tqmbd\" (UID: \"742fb4d8-ced1-4e81-a4fe-af70acd8a987\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:56:59.910367 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:56:59.910329 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:57:00.254933 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:00.254905 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-tqmbd"] Jul 22 01:57:00.257167 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:57:00.257138 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742fb4d8_ced1_4e81_a4fe_af70acd8a987.slice/crio-a1f9071e636ea53fee0d81874537a7dbddc7b5d15df235180123a0485f149795 WatchSource:0}: Error finding container a1f9071e636ea53fee0d81874537a7dbddc7b5d15df235180123a0485f149795: Status 404 returned error can't find the container with id a1f9071e636ea53fee0d81874537a7dbddc7b5d15df235180123a0485f149795 Jul 22 01:57:00.293163 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:00.293124 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" event={"ID":"742fb4d8-ced1-4e81-a4fe-af70acd8a987","Type":"ContainerStarted","Data":"a1f9071e636ea53fee0d81874537a7dbddc7b5d15df235180123a0485f149795"} Jul 22 01:57:02.305525 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:02.305469 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" event={"ID":"742fb4d8-ced1-4e81-a4fe-af70acd8a987","Type":"ContainerStarted","Data":"f8abc0c694e404a4a9399d6db5bc14c78add9ad2d0beb78c931594804a8dc293"} Jul 22 01:57:02.306033 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:02.305615 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:57:02.321291 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:02.321242 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" podStartSLOduration=1.8272861470000001 podStartE2EDuration="3.321226745s" totalImagesPullingTime="1.493940598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:57:02.32019368 +0000 UTC m=+581.260160954" watchObservedRunningTime="2026-07-22 01:57:02.321226745 +0000 UTC m=+581.261194005" Jul 22 01:57:10.237088 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:10.237052 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:10.337994 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:10.337961 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:13.312936 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:13.312906 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-tqmbd" Jul 22 01:57:16.990596 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:16.990566 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:17.057656 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:17.057627 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:19.769576 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:19.769547 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:21.530622 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:21.530594 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:57:21.532223 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:21.532203 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 01:57:25.050024 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.049986 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c"] Jul 22 01:57:25.053838 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.053801 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.054354 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.054326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.054470 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.054390 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.054597 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.054569 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhns\" (UniqueName: \"kubernetes.io/projected/ac9a1482-fe0b-472b-9d71-2d095c122bae-kube-api-access-dvhns\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.054690 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.054616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac9a1482-fe0b-472b-9d71-2d095c122bae-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.054690 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.054648 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.054796 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.054715 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.056382 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.056364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 01:57:25.056682 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.056667 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2n9gm\"" Jul 22 01:57:25.057338 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.057315 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 22 01:57:25.057473 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.057344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 01:57:25.063779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.063757 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c"] Jul 22 01:57:25.082150 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.082102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:25.155604 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.155569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhns\" (UniqueName: \"kubernetes.io/projected/ac9a1482-fe0b-472b-9d71-2d095c122bae-kube-api-access-dvhns\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.155604 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.155605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac9a1482-fe0b-472b-9d71-2d095c122bae-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.155850 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.155634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.155850 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.155674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.155850 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.155706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.155850 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.155749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.156148 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.156127 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.156148 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.156141 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.156250 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.156225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.158149 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.158129 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac9a1482-fe0b-472b-9d71-2d095c122bae-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.158304 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.158290 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac9a1482-fe0b-472b-9d71-2d095c122bae-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.163193 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.163173 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhns\" (UniqueName: \"kubernetes.io/projected/ac9a1482-fe0b-472b-9d71-2d095c122bae-kube-api-access-dvhns\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jk66c\" (UID: \"ac9a1482-fe0b-472b-9d71-2d095c122bae\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.365911 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.365814 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:25.498657 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.498632 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c"] Jul 22 01:57:25.501047 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:57:25.501019 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9a1482_fe0b_472b_9d71_2d095c122bae.slice/crio-042549759d7410b69a3a2c7ec783414dead25c546814442710fc9e816f05deca WatchSource:0}: Error finding container 042549759d7410b69a3a2c7ec783414dead25c546814442710fc9e816f05deca: Status 404 returned error can't find the container with id 042549759d7410b69a3a2c7ec783414dead25c546814442710fc9e816f05deca Jul 22 01:57:25.502468 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:25.502448 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 01:57:26.419276 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:26.419219 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" event={"ID":"ac9a1482-fe0b-472b-9d71-2d095c122bae","Type":"ContainerStarted","Data":"042549759d7410b69a3a2c7ec783414dead25c546814442710fc9e816f05deca"} Jul 22 01:57:27.425859 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:27.425817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" event={"ID":"ac9a1482-fe0b-472b-9d71-2d095c122bae","Type":"ContainerStarted","Data":"1d9bab1734c9917ebf17ee1482d7c99e102a3d55666713de4784aac4a95d74d6"} Jul 22 01:57:27.443341 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:27.443296 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" podStartSLOduration=1.418887804 podStartE2EDuration="2.443279466s" totalImagesPullingTime="1.024391662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:57:27.441532621 +0000 UTC m=+606.381499879" watchObservedRunningTime="2026-07-22 01:57:27.443279466 +0000 UTC m=+606.383246770" Jul 22 01:57:31.945999 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:31.945970 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:35.366779 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:35.366734 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:35.367250 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:35.366815 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:35.379475 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:35.379449 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:35.476522 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:35.476471 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jk66c" Jul 22 01:57:46.350628 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.350592 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn"] Jul 22 01:57:46.354278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.354257 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.357013 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.356994 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 01:57:46.366842 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.366817 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn"] Jul 22 01:57:46.395593 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.395557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:57:46.441058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.441021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53745232-12e3-4e40-891d-2642dcacdc61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.441058 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.441061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.441278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.441092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.441278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.441144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.441278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.441199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.441278 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.441217 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw8zf\" (UniqueName: \"kubernetes.io/projected/53745232-12e3-4e40-891d-2642dcacdc61-kube-api-access-lw8zf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.542748 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.542718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.542946 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.542758 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw8zf\" (UniqueName: \"kubernetes.io/projected/53745232-12e3-4e40-891d-2642dcacdc61-kube-api-access-lw8zf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.542946 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.542815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53745232-12e3-4e40-891d-2642dcacdc61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.542946 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.542839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.542946 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.542871 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.542946 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.542915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.543219 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.543200 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.543292 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.543275 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.543397 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.543375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.545282 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.545259 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53745232-12e3-4e40-891d-2642dcacdc61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.545652 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.545634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53745232-12e3-4e40-891d-2642dcacdc61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.550879 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.550854 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw8zf\" (UniqueName: \"kubernetes.io/projected/53745232-12e3-4e40-891d-2642dcacdc61-kube-api-access-lw8zf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn\" (UID: \"53745232-12e3-4e40-891d-2642dcacdc61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.667725 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.667699 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:46.803467 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:46.803332 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn"] Jul 22 01:57:46.806273 ip-10-0-143-108 kubenswrapper[2554]: W0722 01:57:46.806245 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53745232_12e3_4e40_891d_2642dcacdc61.slice/crio-5caff11a24ca5b9f98f30bf92fd1438dcc05fe3493b716e7305ae7236ccf4897 WatchSource:0}: Error finding container 5caff11a24ca5b9f98f30bf92fd1438dcc05fe3493b716e7305ae7236ccf4897: Status 404 returned error can't find the container with id 5caff11a24ca5b9f98f30bf92fd1438dcc05fe3493b716e7305ae7236ccf4897 Jul 22 01:57:47.521762 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:47.521734 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" event={"ID":"53745232-12e3-4e40-891d-2642dcacdc61","Type":"ContainerStarted","Data":"6a3644af8aee75e85f364433ed672f14322380b31343ec22bfc46c3491ed2390"} Jul 22 01:57:47.522155 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:47.521787 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" event={"ID":"53745232-12e3-4e40-891d-2642dcacdc61","Type":"ContainerStarted","Data":"5caff11a24ca5b9f98f30bf92fd1438dcc05fe3493b716e7305ae7236ccf4897"} Jul 22 01:57:47.538487 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:47.538435 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" podStartSLOduration=1.377118778 podStartE2EDuration="1.538412787s" totalImagesPullingTime="161.294009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:57:47.536911819 +0000 UTC m=+626.476879082" watchObservedRunningTime="2026-07-22 01:57:47.538412787 +0000 UTC m=+626.478380052" Jul 22 01:57:56.668080 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:56.668043 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:56.668532 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:56.668106 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:56.680421 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:56.680396 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:57:57.581530 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:57:57.581477 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn" Jul 22 01:58:01.452769 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.452732 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj"] Jul 22 01:58:01.459541 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.459482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.462353 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.462332 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 22 01:58:01.466328 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.466304 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj"] Jul 22 01:58:01.484063 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.484036 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:01.588651 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.588613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.588824 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.588670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.588824 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.588744 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a378c638-b3c5-4f28-af1e-38793a8ef7e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.588824 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.588784 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.588824 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.588823 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.588986 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.588894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2q7h\" (UniqueName: \"kubernetes.io/projected/a378c638-b3c5-4f28-af1e-38793a8ef7e5-kube-api-access-p2q7h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689343 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689379 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2q7h\" (UniqueName: \"kubernetes.io/projected/a378c638-b3c5-4f28-af1e-38793a8ef7e5-kube-api-access-p2q7h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689572 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a378c638-b3c5-4f28-af1e-38793a8ef7e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689838 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689660 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689838 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689774 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689948 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689870 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.689948 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.689905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.692245 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.692220 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a378c638-b3c5-4f28-af1e-38793a8ef7e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.692453 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.692428 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a378c638-b3c5-4f28-af1e-38793a8ef7e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.698052 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.698021 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2q7h\" (UniqueName: \"kubernetes.io/projected/a378c638-b3c5-4f28-af1e-38793a8ef7e5-kube-api-access-p2q7h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tzrxj\" (UID: \"a378c638-b3c5-4f28-af1e-38793a8ef7e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.771581 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.771464 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:01.915497 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:01.907888 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj"] Jul 22 01:58:02.595334 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:02.595296 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" event={"ID":"a378c638-b3c5-4f28-af1e-38793a8ef7e5","Type":"ContainerStarted","Data":"f56e4a67e24233ce8b9699079e87a6008cbc517dd9cf879ba67b393b59b02fc1"} Jul 22 01:58:02.595334 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:02.595342 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" event={"ID":"a378c638-b3c5-4f28-af1e-38793a8ef7e5","Type":"ContainerStarted","Data":"6cb57b80d2e2b7608a054620b611191434216f1e9a4eaa1731257c1dea09aaa2"} Jul 22 01:58:02.612590 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:02.612540 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" podStartSLOduration=1.443898402 podStartE2EDuration="1.612495342s" totalImagesPullingTime="168.59694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:58:02.611197768 +0000 UTC m=+641.551165022" watchObservedRunningTime="2026-07-22 01:58:02.612495342 +0000 UTC m=+641.552462610" Jul 22 01:58:10.570811 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:10.570777 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:11.772621 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:11.772581 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:11.773117 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:11.772690 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:11.785172 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:11.785149 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:12.653243 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:12.653219 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tzrxj" Jul 22 01:58:19.497786 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:19.497719 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:30.994886 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:30.994853 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:31.097987 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:31.097943 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:58.447547 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:58.447491 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:58.540837 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:58.540807 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:59.741448 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:59.741412 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:58:59.841732 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:58:59.841679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:43.279481 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:43.279375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 01:59:47.289336 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.289300 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bjx2q"] Jul 22 01:59:47.289767 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.289488 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" podUID="aa206478-dfe5-459b-8c00-50aa3230be64" containerName="manager" containerID="cri-o://d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711" gracePeriod=30 Jul 22 01:59:47.549034 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.548978 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:59:47.646464 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.646433 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl7m2\" (UniqueName: \"kubernetes.io/projected/aa206478-dfe5-459b-8c00-50aa3230be64-kube-api-access-dl7m2\") pod \"aa206478-dfe5-459b-8c00-50aa3230be64\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " Jul 22 01:59:47.646640 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.646503 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa206478-dfe5-459b-8c00-50aa3230be64-webhook-cert\") pod \"aa206478-dfe5-459b-8c00-50aa3230be64\" (UID: \"aa206478-dfe5-459b-8c00-50aa3230be64\") " Jul 22 01:59:47.648659 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.648629 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa206478-dfe5-459b-8c00-50aa3230be64-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "aa206478-dfe5-459b-8c00-50aa3230be64" (UID: "aa206478-dfe5-459b-8c00-50aa3230be64"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 01:59:47.648659 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.648635 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa206478-dfe5-459b-8c00-50aa3230be64-kube-api-access-dl7m2" (OuterVolumeSpecName: "kube-api-access-dl7m2") pod "aa206478-dfe5-459b-8c00-50aa3230be64" (UID: "aa206478-dfe5-459b-8c00-50aa3230be64"). InnerVolumeSpecName "kube-api-access-dl7m2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 01:59:47.748053 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.748020 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl7m2\" (UniqueName: \"kubernetes.io/projected/aa206478-dfe5-459b-8c00-50aa3230be64-kube-api-access-dl7m2\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:59:47.748053 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:47.748047 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa206478-dfe5-459b-8c00-50aa3230be64-webhook-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 01:59:48.109431 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.109395 2554 generic.go:356] "Generic (PLEG): container finished" podID="aa206478-dfe5-459b-8c00-50aa3230be64" containerID="d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711" exitCode=0 Jul 22 01:59:48.109647 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.109438 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" Jul 22 01:59:48.109647 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.109487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" event={"ID":"aa206478-dfe5-459b-8c00-50aa3230be64","Type":"ContainerDied","Data":"d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711"} Jul 22 01:59:48.109647 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.109559 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bjx2q" event={"ID":"aa206478-dfe5-459b-8c00-50aa3230be64","Type":"ContainerDied","Data":"31d11a89503983fcc020f46c6a51c453113ce8a6cdc760ed690cbfb9e4da91c6"} Jul 22 01:59:48.109647 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.109591 2554 scope.go:117] "RemoveContainer" containerID="d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711" Jul 22 01:59:48.118460 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.118438 2554 scope.go:117] "RemoveContainer" containerID="d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711" Jul 22 01:59:48.118727 ip-10-0-143-108 kubenswrapper[2554]: E0722 01:59:48.118711 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711\": container with ID starting with d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711 not found: ID does not exist" containerID="d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711" Jul 22 01:59:48.118786 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.118737 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711"} err="failed to get container status \"d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711\": rpc error: code = NotFound desc = could not find container \"d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711\": container with ID starting with d170fc3a73665a0fbe3eba0a3edcaaec01efd0fc994beed0730c0f94bf7d8711 not found: ID does not exist" Jul 22 01:59:48.130580 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.130551 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bjx2q"] Jul 22 01:59:48.134305 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:48.134281 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bjx2q"] Jul 22 01:59:49.565060 ip-10-0-143-108 kubenswrapper[2554]: I0722 01:59:49.565022 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa206478-dfe5-459b-8c00-50aa3230be64" path="/var/lib/kubelet/pods/aa206478-dfe5-459b-8c00-50aa3230be64/volumes" Jul 22 02:00:00.143050 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.143018 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs"] Jul 22 02:00:00.143435 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.143398 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa206478-dfe5-459b-8c00-50aa3230be64" containerName="manager" Jul 22 02:00:00.143435 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.143411 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa206478-dfe5-459b-8c00-50aa3230be64" containerName="manager" Jul 22 02:00:00.143537 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.143463 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa206478-dfe5-459b-8c00-50aa3230be64" containerName="manager" Jul 22 02:00:00.147813 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.147797 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" Jul 22 02:00:00.150463 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.150427 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wrtw7\"" Jul 22 02:00:00.153413 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.153381 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs"] Jul 22 02:00:00.158896 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.158876 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" Jul 22 02:00:00.296049 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:00.296004 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs"] Jul 22 02:00:00.298363 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:00:00.298331 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18190dd_6868_4437_ba3b_82ff26119871.slice/crio-086fc767087ccae893ce2d1a8e4c05663bf10fe7c9e51e6bef117322d1f35c4b WatchSource:0}: Error finding container 086fc767087ccae893ce2d1a8e4c05663bf10fe7c9e51e6bef117322d1f35c4b: Status 404 returned error can't find the container with id 086fc767087ccae893ce2d1a8e4c05663bf10fe7c9e51e6bef117322d1f35c4b Jul 22 02:00:01.178920 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:01.178889 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" event={"ID":"c18190dd-6868-4437-ba3b-82ff26119871","Type":"ContainerStarted","Data":"086fc767087ccae893ce2d1a8e4c05663bf10fe7c9e51e6bef117322d1f35c4b"} Jul 22 02:00:07.209701 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:07.209667 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" event={"ID":"c18190dd-6868-4437-ba3b-82ff26119871","Type":"ContainerStarted","Data":"6cff7c6da31cd9751f03177c650ad510b206f10b83c6b50d14a9c268045056f7"} Jul 22 02:00:07.224634 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:07.224582 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" podStartSLOduration=1.007139488 podStartE2EDuration="7.224565375s" totalImagesPullingTime="6.217425887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:00:07.223062572 +0000 UTC m=+766.163029833" watchObservedRunningTime="2026-07-22 02:00:07.224565375 +0000 UTC m=+766.164532637" Jul 22 02:00:08.215594 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:08.215556 2554 generic.go:356] "Generic (PLEG): container finished" podID="c18190dd-6868-4437-ba3b-82ff26119871" containerID="6cff7c6da31cd9751f03177c650ad510b206f10b83c6b50d14a9c268045056f7" exitCode=0 Jul 22 02:00:08.216031 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:08.215634 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" event={"ID":"c18190dd-6868-4437-ba3b-82ff26119871","Type":"ContainerDied","Data":"6cff7c6da31cd9751f03177c650ad510b206f10b83c6b50d14a9c268045056f7"} Jul 22 02:00:09.358788 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:09.358762 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" Jul 22 02:00:10.225964 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:10.225919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" event={"ID":"c18190dd-6868-4437-ba3b-82ff26119871","Type":"ContainerDied","Data":"086fc767087ccae893ce2d1a8e4c05663bf10fe7c9e51e6bef117322d1f35c4b"} Jul 22 02:00:10.226170 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:10.225975 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="086fc767087ccae893ce2d1a8e4c05663bf10fe7c9e51e6bef117322d1f35c4b" Jul 22 02:00:10.226170 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:10.225930 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744760-fsbrs" Jul 22 02:00:49.018481 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.018442 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bskrm"] Jul 22 02:00:49.018918 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.018843 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c18190dd-6868-4437-ba3b-82ff26119871" containerName="cleanup" Jul 22 02:00:49.018918 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.018856 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c18190dd-6868-4437-ba3b-82ff26119871" containerName="cleanup" Jul 22 02:00:49.018990 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.018922 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c18190dd-6868-4437-ba3b-82ff26119871" containerName="cleanup" Jul 22 02:00:49.022086 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.022071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.024461 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.024442 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 02:00:49.025448 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.025430 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 02:00:49.025525 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.025433 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n8jqz\"" Jul 22 02:00:49.031747 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.031725 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bskrm"] Jul 22 02:00:49.091609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.091561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef512028-dc64-468d-96fe-ce44b46ddf39-webhook-cert\") pod \"maas-controller-7db775cb8b-bskrm\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.091808 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.091628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrk9\" (UniqueName: \"kubernetes.io/projected/ef512028-dc64-468d-96fe-ce44b46ddf39-kube-api-access-2jrk9\") pod \"maas-controller-7db775cb8b-bskrm\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.192871 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.192837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef512028-dc64-468d-96fe-ce44b46ddf39-webhook-cert\") pod \"maas-controller-7db775cb8b-bskrm\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.193075 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.192884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrk9\" (UniqueName: \"kubernetes.io/projected/ef512028-dc64-468d-96fe-ce44b46ddf39-kube-api-access-2jrk9\") pod \"maas-controller-7db775cb8b-bskrm\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.195447 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.195422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef512028-dc64-468d-96fe-ce44b46ddf39-webhook-cert\") pod \"maas-controller-7db775cb8b-bskrm\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.202472 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.202448 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrk9\" (UniqueName: \"kubernetes.io/projected/ef512028-dc64-468d-96fe-ce44b46ddf39-kube-api-access-2jrk9\") pod \"maas-controller-7db775cb8b-bskrm\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.333014 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.332920 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:49.469093 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:49.469061 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bskrm"] Jul 22 02:00:49.472493 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:00:49.472464 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef512028_dc64_468d_96fe_ce44b46ddf39.slice/crio-784b317816abab272047648e7f93ac567ca07913590ffe40d66ec164f5400b22 WatchSource:0}: Error finding container 784b317816abab272047648e7f93ac567ca07913590ffe40d66ec164f5400b22: Status 404 returned error can't find the container with id 784b317816abab272047648e7f93ac567ca07913590ffe40d66ec164f5400b22 Jul 22 02:00:50.421422 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:50.421383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bskrm" event={"ID":"ef512028-dc64-468d-96fe-ce44b46ddf39","Type":"ContainerStarted","Data":"f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9"} Jul 22 02:00:50.421817 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:50.421469 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:00:50.421817 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:50.421489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bskrm" event={"ID":"ef512028-dc64-468d-96fe-ce44b46ddf39","Type":"ContainerStarted","Data":"784b317816abab272047648e7f93ac567ca07913590ffe40d66ec164f5400b22"} Jul 22 02:00:50.442418 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:00:50.442369 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db775cb8b-bskrm" podStartSLOduration=2.030816886 podStartE2EDuration="2.442353385s" totalImagesPullingTime="411.536499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:00:50.43954981 +0000 UTC m=+809.379517070" watchObservedRunningTime="2026-07-22 02:00:50.442353385 +0000 UTC m=+809.382320646" Jul 22 02:01:01.429149 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:01.429115 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:01:04.720249 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:04.720209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:04.773530 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:04.773477 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:05.976142 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:05.976112 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:06.081557 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.081528 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bskrm"] Jul 22 02:01:06.081756 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.081729 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7db775cb8b-bskrm" podUID="ef512028-dc64-468d-96fe-ce44b46ddf39" containerName="manager" containerID="cri-o://f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9" gracePeriod=30 Jul 22 02:01:06.328662 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.328636 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:01:06.461693 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.461666 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrk9\" (UniqueName: \"kubernetes.io/projected/ef512028-dc64-468d-96fe-ce44b46ddf39-kube-api-access-2jrk9\") pod \"ef512028-dc64-468d-96fe-ce44b46ddf39\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " Jul 22 02:01:06.461876 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.461732 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef512028-dc64-468d-96fe-ce44b46ddf39-webhook-cert\") pod \"ef512028-dc64-468d-96fe-ce44b46ddf39\" (UID: \"ef512028-dc64-468d-96fe-ce44b46ddf39\") " Jul 22 02:01:06.463937 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.463903 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef512028-dc64-468d-96fe-ce44b46ddf39-kube-api-access-2jrk9" (OuterVolumeSpecName: "kube-api-access-2jrk9") pod "ef512028-dc64-468d-96fe-ce44b46ddf39" (UID: "ef512028-dc64-468d-96fe-ce44b46ddf39"). InnerVolumeSpecName "kube-api-access-2jrk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:01:06.464052 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.463963 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef512028-dc64-468d-96fe-ce44b46ddf39-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef512028-dc64-468d-96fe-ce44b46ddf39" (UID: "ef512028-dc64-468d-96fe-ce44b46ddf39"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:01:06.500705 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.500628 2554 generic.go:356] "Generic (PLEG): container finished" podID="ef512028-dc64-468d-96fe-ce44b46ddf39" containerID="f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9" exitCode=0 Jul 22 02:01:06.500705 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.500672 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-bskrm" Jul 22 02:01:06.500887 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.500712 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bskrm" event={"ID":"ef512028-dc64-468d-96fe-ce44b46ddf39","Type":"ContainerDied","Data":"f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9"} Jul 22 02:01:06.500887 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.500766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-bskrm" event={"ID":"ef512028-dc64-468d-96fe-ce44b46ddf39","Type":"ContainerDied","Data":"784b317816abab272047648e7f93ac567ca07913590ffe40d66ec164f5400b22"} Jul 22 02:01:06.500887 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.500789 2554 scope.go:117] "RemoveContainer" containerID="f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9" Jul 22 02:01:06.510015 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.509999 2554 scope.go:117] "RemoveContainer" containerID="f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9" Jul 22 02:01:06.510268 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:01:06.510243 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9\": container with ID starting with f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9 not found: ID does not exist" containerID="f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9" Jul 22 02:01:06.510319 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.510279 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9"} err="failed to get container status \"f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9\": rpc error: code = NotFound desc = could not find container \"f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9\": container with ID starting with f6e44241f666b717c07ce4a57fd708661cb4f3faf0f2dbd7d888c4dcf317c5c9 not found: ID does not exist" Jul 22 02:01:06.521960 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.521937 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bskrm"] Jul 22 02:01:06.527643 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.527623 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-bskrm"] Jul 22 02:01:06.562707 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.562678 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrk9\" (UniqueName: \"kubernetes.io/projected/ef512028-dc64-468d-96fe-ce44b46ddf39-kube-api-access-2jrk9\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:01:06.562707 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:06.562703 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef512028-dc64-468d-96fe-ce44b46ddf39-webhook-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:01:07.235052 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.235013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:07.366373 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.366338 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db775cb8b-4bxdn"] Jul 22 02:01:07.366741 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.366714 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef512028-dc64-468d-96fe-ce44b46ddf39" containerName="manager" Jul 22 02:01:07.366788 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.366744 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef512028-dc64-468d-96fe-ce44b46ddf39" containerName="manager" Jul 22 02:01:07.367016 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.366808 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef512028-dc64-468d-96fe-ce44b46ddf39" containerName="manager" Jul 22 02:01:07.371190 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.371165 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.374365 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.374346 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 02:01:07.374365 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.374362 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 02:01:07.374577 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.374369 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n8jqz\"" Jul 22 02:01:07.378258 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.378236 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-4bxdn"] Jul 22 02:01:07.472772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.472727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d2bc59d-fef7-4602-a6a1-fb19c382c20a-webhook-cert\") pod \"maas-controller-7db775cb8b-4bxdn\" (UID: \"1d2bc59d-fef7-4602-a6a1-fb19c382c20a\") " pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.472772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.472772 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qf6\" (UniqueName: \"kubernetes.io/projected/1d2bc59d-fef7-4602-a6a1-fb19c382c20a-kube-api-access-p9qf6\") pod \"maas-controller-7db775cb8b-4bxdn\" (UID: \"1d2bc59d-fef7-4602-a6a1-fb19c382c20a\") " pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.565008 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.564922 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef512028-dc64-468d-96fe-ce44b46ddf39" path="/var/lib/kubelet/pods/ef512028-dc64-468d-96fe-ce44b46ddf39/volumes" Jul 22 02:01:07.573849 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.573811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d2bc59d-fef7-4602-a6a1-fb19c382c20a-webhook-cert\") pod \"maas-controller-7db775cb8b-4bxdn\" (UID: \"1d2bc59d-fef7-4602-a6a1-fb19c382c20a\") " pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.573992 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.573899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qf6\" (UniqueName: \"kubernetes.io/projected/1d2bc59d-fef7-4602-a6a1-fb19c382c20a-kube-api-access-p9qf6\") pod \"maas-controller-7db775cb8b-4bxdn\" (UID: \"1d2bc59d-fef7-4602-a6a1-fb19c382c20a\") " pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.576422 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.576402 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d2bc59d-fef7-4602-a6a1-fb19c382c20a-webhook-cert\") pod \"maas-controller-7db775cb8b-4bxdn\" (UID: \"1d2bc59d-fef7-4602-a6a1-fb19c382c20a\") " pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.583017 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.582984 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qf6\" (UniqueName: \"kubernetes.io/projected/1d2bc59d-fef7-4602-a6a1-fb19c382c20a-kube-api-access-p9qf6\") pod \"maas-controller-7db775cb8b-4bxdn\" (UID: \"1d2bc59d-fef7-4602-a6a1-fb19c382c20a\") " pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.683343 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.683311 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:07.820907 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:07.820884 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db775cb8b-4bxdn"] Jul 22 02:01:07.822666 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:01:07.822637 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2bc59d_fef7_4602_a6a1_fb19c382c20a.slice/crio-3d1ab42579cbe38b69b6cd44dc51f38eb285085fc2b5e79c9a0d4fe0b58b7335 WatchSource:0}: Error finding container 3d1ab42579cbe38b69b6cd44dc51f38eb285085fc2b5e79c9a0d4fe0b58b7335: Status 404 returned error can't find the container with id 3d1ab42579cbe38b69b6cd44dc51f38eb285085fc2b5e79c9a0d4fe0b58b7335 Jul 22 02:01:08.513633 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:08.513587 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" event={"ID":"1d2bc59d-fef7-4602-a6a1-fb19c382c20a","Type":"ContainerStarted","Data":"f19c1046f7918f9a063bd781d696556ca105b050180554a063577b46cbc257d5"} Jul 22 02:01:08.514068 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:08.513669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" event={"ID":"1d2bc59d-fef7-4602-a6a1-fb19c382c20a","Type":"ContainerStarted","Data":"3d1ab42579cbe38b69b6cd44dc51f38eb285085fc2b5e79c9a0d4fe0b58b7335"} Jul 22 02:01:08.514068 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:08.513749 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:08.532086 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:08.532037 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" podStartSLOduration=1.211186913 podStartE2EDuration="1.532021791s" totalImagesPullingTime="320.834878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:01:08.529734728 +0000 UTC m=+827.469701989" watchObservedRunningTime="2026-07-22 02:01:08.532021791 +0000 UTC m=+827.471989051" Jul 22 02:01:19.521384 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:19.521351 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db775cb8b-4bxdn" Jul 22 02:01:41.351092 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:41.351057 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:41.451003 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:41.450975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:47.302112 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:47.302077 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:47.377692 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:47.377665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:47.474305 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:47.474271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:47.674002 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:47.673979 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:53.441200 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:53.441162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:01:53.542079 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:01:53.542047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:02:21.564416 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:02:21.564314 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:02:21.564416 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:02:21.564386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:03:01.562228 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:03:01.562188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:20.211998 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:03:20.211965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:03:20.312848 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:03:20.312816 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:19.254559 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:05:19.254461 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:05:19.313479 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:05:19.313443 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:07:21.593290 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:07:21.593263 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:07:21.596327 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:07:21.596305 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:07:23.491441 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:07:23.491410 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:09:43.636744 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:09:43.636703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:01.315756 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:10:01.315721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:18.206072 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:10:18.206034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:19.658287 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:10:19.658240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:40.014992 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:10:40.014954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:44.033149 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:10:44.033114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:10:44.095826 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:10:44.095797 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:12:21.621871 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:12:21.621837 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:12:21.626793 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:12:21.626768 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:13:25.330037 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:25.330001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:29.604179 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:29.604148 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:48.324097 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:48.324063 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:51.575823 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:51.575794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:51.675449 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:51.675420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:52.076539 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:52.076474 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:57.767294 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:57.767261 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:57.835703 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:57.835672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:58.022443 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:58.022365 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:58.351918 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:58.351833 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:13:58.634309 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:13:58.634222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:01.179445 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:01.179409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:01.276458 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:01.276421 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:01.440238 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:01.440154 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:01.924333 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:01.924306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:02.029685 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:02.029653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:26.857562 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:26.857461 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6"] Jul 22 02:14:26.861520 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:26.861484 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:26.864059 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:26.864019 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:14:26.864370 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:26.864349 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wrtw7\"" Jul 22 02:14:26.868225 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:26.868188 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6"] Jul 22 02:14:26.960252 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:26.960219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68348ff4-d332-4059-a382-ec41f476049a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6\" (UID: \"68348ff4-d332-4059-a382-ec41f476049a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:27.061666 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:27.061632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68348ff4-d332-4059-a382-ec41f476049a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6\" (UID: \"68348ff4-d332-4059-a382-ec41f476049a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:27.062259 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:27.062238 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68348ff4-d332-4059-a382-ec41f476049a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6\" (UID: \"68348ff4-d332-4059-a382-ec41f476049a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:27.174530 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:27.174488 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:27.310567 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:27.310541 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6"] Jul 22 02:14:27.312352 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:14:27.312319 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68348ff4_d332_4059_a382_ec41f476049a.slice/crio-a6d3a31009115cf48eb026969e3daa3ccb3e2091b831bd1d244b65c50e8f9027 WatchSource:0}: Error finding container a6d3a31009115cf48eb026969e3daa3ccb3e2091b831bd1d244b65c50e8f9027: Status 404 returned error can't find the container with id a6d3a31009115cf48eb026969e3daa3ccb3e2091b831bd1d244b65c50e8f9027 Jul 22 02:14:27.386693 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:27.386661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" event={"ID":"68348ff4-d332-4059-a382-ec41f476049a","Type":"ContainerStarted","Data":"a6d3a31009115cf48eb026969e3daa3ccb3e2091b831bd1d244b65c50e8f9027"} Jul 22 02:14:28.393331 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:28.393241 2554 generic.go:356] "Generic (PLEG): container finished" podID="68348ff4-d332-4059-a382-ec41f476049a" containerID="958776c05e65f0efbb42b3ec923dc0215f40cd51b3de099e1567ce393bd51846" exitCode=0 Jul 22 02:14:28.393707 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:28.393328 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" event={"ID":"68348ff4-d332-4059-a382-ec41f476049a","Type":"ContainerDied","Data":"958776c05e65f0efbb42b3ec923dc0215f40cd51b3de099e1567ce393bd51846"} Jul 22 02:14:29.530468 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:29.530439 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:29.584963 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:29.584931 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68348ff4-d332-4059-a382-ec41f476049a-maas-api-service-ca\") pod \"68348ff4-d332-4059-a382-ec41f476049a\" (UID: \"68348ff4-d332-4059-a382-ec41f476049a\") " Jul 22 02:14:29.585293 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:29.585268 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68348ff4-d332-4059-a382-ec41f476049a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68348ff4-d332-4059-a382-ec41f476049a" (UID: "68348ff4-d332-4059-a382-ec41f476049a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:14:29.686606 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:29.686574 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68348ff4-d332-4059-a382-ec41f476049a-maas-api-service-ca\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:14:30.404337 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:30.404310 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" Jul 22 02:14:30.404531 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:30.404348 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6" event={"ID":"68348ff4-d332-4059-a382-ec41f476049a","Type":"ContainerDied","Data":"a6d3a31009115cf48eb026969e3daa3ccb3e2091b831bd1d244b65c50e8f9027"} Jul 22 02:14:30.404531 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:30.404395 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6d3a31009115cf48eb026969e3daa3ccb3e2091b831bd1d244b65c50e8f9027" Jul 22 02:14:37.302247 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:37.302210 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:41.934308 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:41.934272 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:41.934836 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:41.934647 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6"] Jul 22 02:14:41.936894 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:41.936870 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-45f6f391-xv8j6"] Jul 22 02:14:42.103175 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:42.103147 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:42.352142 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:42.352054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:42.624960 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:42.624878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:42.723880 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:42.723843 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:42.858207 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:42.858180 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:43.178032 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.178002 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78"] Jul 22 02:14:43.178403 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.178390 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68348ff4-d332-4059-a382-ec41f476049a" containerName="revoke-keys" Jul 22 02:14:43.178403 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.178402 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="68348ff4-d332-4059-a382-ec41f476049a" containerName="revoke-keys" Jul 22 02:14:43.178480 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.178462 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="68348ff4-d332-4059-a382-ec41f476049a" containerName="revoke-keys" Jul 22 02:14:43.181929 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.181911 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.184562 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.184541 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-57750b46-gw-openshift-default-dockercfg-2rqj9\"" Jul 22 02:14:43.193061 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.193038 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78"] Jul 22 02:14:43.202611 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.202584 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:43.303429 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.303392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:43.306606 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-envoy\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306748 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306621 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-token\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306748 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306653 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nncjl\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-kube-api-access-nncjl\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306748 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istiod-ca-cert\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306748 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-podinfo\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306748 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-data\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306944 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306769 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-credential-socket\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306944 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-socket\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.306944 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.306812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-certs\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.407745 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.407709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-data\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.407745 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.407748 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-credential-socket\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.407970 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.407779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-socket\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.407970 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.407803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-certs\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.407970 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.407899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-envoy\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.407970 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.407937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-token\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408158 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nncjl\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-kube-api-access-nncjl\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408158 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istiod-ca-cert\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408270 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-podinfo\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408270 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408174 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-data\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408270 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-credential-socket\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408270 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408248 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-socket\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408467 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408351 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-certs\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.408808 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.408793 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istiod-ca-cert\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.410354 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.410329 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-envoy\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.410576 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.410560 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-podinfo\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.419852 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.419827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nncjl\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-kube-api-access-nncjl\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.420831 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.420812 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-token\") pod \"e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.492447 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.492359 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:43.565633 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.565600 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68348ff4-d332-4059-a382-ec41f476049a" path="/var/lib/kubelet/pods/68348ff4-d332-4059-a382-ec41f476049a/volumes" Jul 22 02:14:43.641520 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.641477 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78"] Jul 22 02:14:43.643710 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:14:43.643685 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77dc17f_1ba9_4864_b2e2_ca9443f87891.slice/crio-aeb749ecdd6f59947bbaa73aaae88850fcd9dd5062e685a81387e939cfcec86c WatchSource:0}: Error finding container aeb749ecdd6f59947bbaa73aaae88850fcd9dd5062e685a81387e939cfcec86c: Status 404 returned error can't find the container with id aeb749ecdd6f59947bbaa73aaae88850fcd9dd5062e685a81387e939cfcec86c Jul 22 02:14:43.645854 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.645817 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:43.645958 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.645910 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:43.645958 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:43.645945 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:44.474307 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:44.474271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" event={"ID":"b77dc17f-1ba9-4864-b2e2-ca9443f87891","Type":"ContainerStarted","Data":"5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e"} Jul 22 02:14:44.474831 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:44.474321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" event={"ID":"b77dc17f-1ba9-4864-b2e2-ca9443f87891","Type":"ContainerStarted","Data":"aeb749ecdd6f59947bbaa73aaae88850fcd9dd5062e685a81387e939cfcec86c"} Jul 22 02:14:44.492778 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:44.492754 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:44.496588 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:44.496541 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" podStartSLOduration=1.496526867 podStartE2EDuration="1.496526867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:14:44.494083361 +0000 UTC m=+1643.434050627" watchObservedRunningTime="2026-07-22 02:14:44.496526867 +0000 UTC m=+1643.436494122" Jul 22 02:14:44.498486 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:44.498466 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:45.480302 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:45.480275 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:45.481312 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:45.481296 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:14:45.997057 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:45.997013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:47.091906 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:47.091873 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:14:59.556818 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:59.556778 2554 generic.go:356] "Generic (PLEG): container finished" podID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerID="5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e" exitCode=0 Jul 22 02:14:59.557244 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:59.556851 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" event={"ID":"b77dc17f-1ba9-4864-b2e2-ca9443f87891","Type":"ContainerDied","Data":"5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e"} Jul 22 02:14:59.557302 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:59.557287 2554 scope.go:117] "RemoveContainer" containerID="5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e" Jul 22 02:14:59.558327 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:59.558298 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:59.558397 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:59.558380 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:14:59.558444 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:14:59.558428 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:00.480802 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:00.480767 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:00.564262 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:00.564226 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" event={"ID":"b77dc17f-1ba9-4864-b2e2-ca9443f87891","Type":"ContainerStarted","Data":"d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17"} Jul 22 02:15:01.492847 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:01.492805 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:01.494566 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:01.494533 2554 patch_prober.go:28] interesting pod/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 02:15:01.494699 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:01.494622 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 02:15:02.493768 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:02.493723 2554 patch_prober.go:28] interesting pod/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 02:15:02.494324 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:02.493789 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 02:15:03.493654 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:03.493612 2554 patch_prober.go:28] interesting pod/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 02:15:03.493968 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:03.493937 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 02:15:04.493737 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:04.493693 2554 patch_prober.go:28] interesting pod/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 02:15:04.494076 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:04.494044 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 02:15:05.496801 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:05.496768 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:05.497287 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:05.497147 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:05.497841 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:05.497818 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:21.295184 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:21.295152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:21.395258 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:21.395219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:21.624119 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:21.624028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:26.151317 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:26.151280 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:26.295334 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:26.295300 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78"] Jul 22 02:15:26.295569 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:26.295502 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" containerID="cri-o://d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17" gracePeriod=30 Jul 22 02:15:26.323946 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:26.323919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:26.590478 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:26.590445 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:26.850333 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:26.850243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:27.182382 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.182341 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj"] Jul 22 02:15:27.186199 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.186176 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.189554 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.189533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-353f6df7-openshift-default-dockercfg-lwx76\"" Jul 22 02:15:27.199340 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.199313 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj"] Jul 22 02:15:27.215126 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.215097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:27.303156 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303113 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4323198-3afb-4e63-b08d-985b70b86309-istio-podinfo\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303346 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-data\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303346 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-credential-socket\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303346 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303298 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-envoy\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303354 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-certs\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303377 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g268\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-kube-api-access-8g268\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-istio-token\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4323198-3afb-4e63-b08d-985b70b86309-istiod-ca-cert\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.303488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.303482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-socket\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404230 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4323198-3afb-4e63-b08d-985b70b86309-istio-podinfo\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404230 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-data\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-credential-socket\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-envoy\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-certs\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404380 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g268\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-kube-api-access-8g268\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-istio-token\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4323198-3afb-4e63-b08d-985b70b86309-istiod-ca-cert\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404457 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-socket\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404855 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404726 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-data\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404855 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-credential-socket\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.404855 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.404845 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-socket\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.405134 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.405006 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-certs\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.405246 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.405229 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4323198-3afb-4e63-b08d-985b70b86309-istiod-ca-cert\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.406820 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.406796 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-envoy\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.407000 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.406980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4323198-3afb-4e63-b08d-985b70b86309-istio-podinfo\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.413796 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.413774 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-istio-token\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.414007 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.413990 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g268\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-kube-api-access-8g268\") pod \"e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.437245 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.437183 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:27.496890 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.496846 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:27.636542 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.636497 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj"] Jul 22 02:15:27.638089 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:15:27.638064 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4323198_3afb_4e63_b08d_985b70b86309.slice/crio-49f0e83cb3bf948658a6a9d6993b203ad6cc3384e06d6bf1d2eec0a1ee50de16 WatchSource:0}: Error finding container 49f0e83cb3bf948658a6a9d6993b203ad6cc3384e06d6bf1d2eec0a1ee50de16: Status 404 returned error can't find the container with id 49f0e83cb3bf948658a6a9d6993b203ad6cc3384e06d6bf1d2eec0a1ee50de16 Jul 22 02:15:27.640337 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.640291 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:27.640408 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.640389 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:27.640461 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.640443 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:27.695972 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:27.695942 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" event={"ID":"d4323198-3afb-4e63-b08d-985b70b86309","Type":"ContainerStarted","Data":"49f0e83cb3bf948658a6a9d6993b203ad6cc3384e06d6bf1d2eec0a1ee50de16"} Jul 22 02:15:28.702844 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:28.702805 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" event={"ID":"d4323198-3afb-4e63-b08d-985b70b86309","Type":"ContainerStarted","Data":"d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8"} Jul 22 02:15:28.725357 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:28.725311 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podStartSLOduration=1.72529441 podStartE2EDuration="1.72529441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:15:28.722313602 +0000 UTC m=+1687.662280862" watchObservedRunningTime="2026-07-22 02:15:28.72529441 +0000 UTC m=+1687.665261672" Jul 22 02:15:29.497562 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:29.497495 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:29.502436 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:29.502411 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:29.708089 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:29.708053 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:29.708991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:29.708971 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:30.093990 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:30.093953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:30.182296 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:30.182269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:30.257412 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:30.257386 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:30.368104 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:30.368018 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:30.823270 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:30.823242 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:30.928078 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:30.928047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:15:31.554403 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.554342 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:31.645734 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645700 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-envoy\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.645931 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645766 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-data\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.645931 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645819 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nncjl\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-kube-api-access-nncjl\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.645931 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645876 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-token\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.645931 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645899 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-podinfo\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.646165 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645945 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-socket\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.646165 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.645980 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-credential-socket\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.646165 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646003 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-certs\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.646165 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646054 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istiod-ca-cert\") pod \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\" (UID: \"b77dc17f-1ba9-4864-b2e2-ca9443f87891\") " Jul 22 02:15:31.646354 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646286 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:31.646575 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646458 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:31.646575 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646534 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.646782 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646682 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:31.646782 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646692 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-data" (OuterVolumeSpecName: "istio-data") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:31.646782 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.646623 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:15:31.648539 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.648501 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:15:31.648725 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.648705 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:15:31.648797 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.648723 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-token" (OuterVolumeSpecName: "istio-token") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:15:31.648797 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.648736 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-kube-api-access-nncjl" (OuterVolumeSpecName: "kube-api-access-nncjl") pod "b77dc17f-1ba9-4864-b2e2-ca9443f87891" (UID: "b77dc17f-1ba9-4864-b2e2-ca9443f87891"). InnerVolumeSpecName "kube-api-access-nncjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:15:31.719669 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.719639 2554 generic.go:356] "Generic (PLEG): container finished" podID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerID="d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17" exitCode=0 Jul 22 02:15:31.719845 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.719690 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" Jul 22 02:15:31.719845 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.719729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" event={"ID":"b77dc17f-1ba9-4864-b2e2-ca9443f87891","Type":"ContainerDied","Data":"d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17"} Jul 22 02:15:31.719845 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.719794 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78" event={"ID":"b77dc17f-1ba9-4864-b2e2-ca9443f87891","Type":"ContainerDied","Data":"aeb749ecdd6f59947bbaa73aaae88850fcd9dd5062e685a81387e939cfcec86c"} Jul 22 02:15:31.719845 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.719819 2554 scope.go:117] "RemoveContainer" containerID="d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17" Jul 22 02:15:31.731886 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.731867 2554 scope.go:117] "RemoveContainer" containerID="5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e" Jul 22 02:15:31.743545 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.743495 2554 scope.go:117] "RemoveContainer" containerID="d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17" Jul 22 02:15:31.743887 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:15:31.743868 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17\": container with ID starting with d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17 not found: ID does not exist" containerID="d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17" Jul 22 02:15:31.743933 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.743900 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17"} err="failed to get container status \"d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17\": rpc error: code = NotFound desc = could not find container \"d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17\": container with ID starting with d88a6998e19ce74a9fee27e8ba0cdf9e6e4fdeff63599f57ac7463711380af17 not found: ID does not exist" Jul 22 02:15:31.743933 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.743920 2554 scope.go:117] "RemoveContainer" containerID="5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e" Jul 22 02:15:31.744220 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:15:31.744202 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e\": container with ID starting with 5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e not found: ID does not exist" containerID="5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e" Jul 22 02:15:31.744279 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.744226 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e"} err="failed to get container status \"5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e\": rpc error: code = NotFound desc = could not find container \"5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e\": container with ID starting with 5db73921106f48c097b0613e0b655f9fefaa26f8664f0fa8d3e5721e65337a6e not found: ID does not exist" Jul 22 02:15:31.744883 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.744863 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78"] Jul 22 02:15:31.747662 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747641 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nncjl\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-kube-api-access-nncjl\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747665 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747682 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747694 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747708 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747721 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747733 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.747772 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.747744 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77dc17f-1ba9-4864-b2e2-ca9443f87891-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:15:31.748556 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:31.748534 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-57750b46-gw-openshift-default-7cf858d97f-jkx78"] Jul 22 02:15:33.566150 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:33.566115 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" path="/var/lib/kubelet/pods/b77dc17f-1ba9-4864-b2e2-ca9443f87891/volumes" Jul 22 02:15:44.709570 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.709534 2554 patch_prober.go:28] interesting pod/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:15:44.709994 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.709590 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:15:44.792964 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.792930 2554 generic.go:356] "Generic (PLEG): container finished" podID="d4323198-3afb-4e63-b08d-985b70b86309" containerID="d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8" exitCode=0 Jul 22 02:15:44.793129 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.793005 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" event={"ID":"d4323198-3afb-4e63-b08d-985b70b86309","Type":"ContainerDied","Data":"d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8"} Jul 22 02:15:44.793402 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.793389 2554 scope.go:117] "RemoveContainer" containerID="d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8" Jul 22 02:15:44.794386 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.794362 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:44.794446 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.794427 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:44.794491 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:44.794462 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:15:45.804651 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:45.803692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" event={"ID":"d4323198-3afb-4e63-b08d-985b70b86309","Type":"ContainerStarted","Data":"09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091"} Jul 22 02:15:46.497598 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:46.497561 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:46.497989 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:46.497962 2554 patch_prober.go:28] interesting pod/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:15:46.498164 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:46.498138 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:15:47.497489 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:47.497443 2554 patch_prober.go:28] interesting pod/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:15:47.498026 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:47.497548 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:15:48.497819 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:48.497769 2554 patch_prober.go:28] interesting pod/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:15:48.498341 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:48.497845 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:15:49.497939 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:49.497894 2554 patch_prober.go:28] interesting pod/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 02:15:49.498446 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:49.497963 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 02:15:50.501359 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:50.501327 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:50.501743 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:50.501716 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:15:50.502402 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:15:50.502385 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:16:06.554066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:06.554030 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:11.145749 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:11.145711 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:12.435033 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:12.435002 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj"] Jul 22 02:16:12.435565 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:12.435225 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" containerID="cri-o://09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091" gracePeriod=30 Jul 22 02:16:12.459386 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:12.459339 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:12.710438 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:12.710341 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:12.953479 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:12.953446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:13.286773 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:13.286742 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:13.458915 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:13.458884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:15.990400 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:15.990364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:16.070858 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:16.070824 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:16.243064 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:16.242964 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:16.484195 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:16.484166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:16.803748 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:16.803713 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:16.901209 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:16.901169 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:17.688850 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.688825 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:16:17.779446 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779356 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g268\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-kube-api-access-8g268\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779446 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779388 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4323198-3afb-4e63-b08d-985b70b86309-istiod-ca-cert\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779446 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779444 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-socket\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779462 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-istio-token\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779480 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-certs\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779544 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-envoy\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779592 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-data\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779645 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4323198-3afb-4e63-b08d-985b70b86309-istio-podinfo\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.779765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779664 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-credential-socket\") pod \"d4323198-3afb-4e63-b08d-985b70b86309\" (UID: \"d4323198-3afb-4e63-b08d-985b70b86309\") " Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779789 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779869 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4323198-3afb-4e63-b08d-985b70b86309-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779868 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.779979 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.780002 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.780019 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.780066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.780033 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4323198-3afb-4e63-b08d-985b70b86309-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.780918 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.780891 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:16:17.781893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.781864 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-kube-api-access-8g268" (OuterVolumeSpecName: "kube-api-access-8g268") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "kube-api-access-8g268". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:16:17.781985 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.781892 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:16:17.782418 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.782394 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4323198-3afb-4e63-b08d-985b70b86309-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:16:17.782681 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.782653 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4323198-3afb-4e63-b08d-985b70b86309" (UID: "d4323198-3afb-4e63-b08d-985b70b86309"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:16:17.881364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.881323 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.881364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.881354 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.881364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.881368 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.881693 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.881379 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4323198-3afb-4e63-b08d-985b70b86309-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.881693 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.881390 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4323198-3afb-4e63-b08d-985b70b86309-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.881693 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.881402 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g268\" (UniqueName: \"kubernetes.io/projected/d4323198-3afb-4e63-b08d-985b70b86309-kube-api-access-8g268\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:16:17.968280 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.968244 2554 generic.go:356] "Generic (PLEG): container finished" podID="d4323198-3afb-4e63-b08d-985b70b86309" containerID="09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091" exitCode=0 Jul 22 02:16:17.968439 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.968294 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" Jul 22 02:16:17.968439 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.968334 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" event={"ID":"d4323198-3afb-4e63-b08d-985b70b86309","Type":"ContainerDied","Data":"09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091"} Jul 22 02:16:17.968439 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.968392 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj" event={"ID":"d4323198-3afb-4e63-b08d-985b70b86309","Type":"ContainerDied","Data":"49f0e83cb3bf948658a6a9d6993b203ad6cc3384e06d6bf1d2eec0a1ee50de16"} Jul 22 02:16:17.968439 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.968416 2554 scope.go:117] "RemoveContainer" containerID="09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091" Jul 22 02:16:17.977926 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.977908 2554 scope.go:117] "RemoveContainer" containerID="d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8" Jul 22 02:16:17.986072 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.986055 2554 scope.go:117] "RemoveContainer" containerID="09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091" Jul 22 02:16:17.986340 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:16:17.986322 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091\": container with ID starting with 09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091 not found: ID does not exist" containerID="09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091" Jul 22 02:16:17.986385 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.986350 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091"} err="failed to get container status \"09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091\": rpc error: code = NotFound desc = could not find container \"09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091\": container with ID starting with 09797a83a5e3ed613875b813570955a6fd76c6d760380babb1d602a791c4b091 not found: ID does not exist" Jul 22 02:16:17.986385 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.986366 2554 scope.go:117] "RemoveContainer" containerID="d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8" Jul 22 02:16:17.986622 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:16:17.986598 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8\": container with ID starting with d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8 not found: ID does not exist" containerID="d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8" Jul 22 02:16:17.986686 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.986627 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8"} err="failed to get container status \"d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8\": rpc error: code = NotFound desc = could not find container \"d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8\": container with ID starting with d981fa6468757c1310f9d477f1fe6813457d372ff0be0d3a3358342bb0066cb8 not found: ID does not exist" Jul 22 02:16:17.991416 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.991393 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj"] Jul 22 02:16:17.996160 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:17.996139 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-353f6df7-openshift-default-566b49fd95-wr7tj"] Jul 22 02:16:19.564561 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:19.564501 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4323198-3afb-4e63-b08d-985b70b86309" path="/var/lib/kubelet/pods/d4323198-3afb-4e63-b08d-985b70b86309/volumes" Jul 22 02:16:27.917823 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:27.917793 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:28.019417 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:28.019386 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:37.561747 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:37.561712 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:37.670979 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:37.670945 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:51.411628 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:51.411571 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:55.999628 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:55.999592 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:56.169560 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:56.169494 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:56.443083 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:56.443055 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:56.952979 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:56.952948 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:57.057139 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:57.057108 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:57.153352 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:57.153313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:58.700393 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:16:58.700358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:05.067954 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:05.067925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:05.176391 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:05.176356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:05.268986 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:05.268950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:05.375756 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:05.375683 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:10.985159 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:10.985128 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:21.650691 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:21.650657 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:17:21.663723 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:21.663694 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:17:37.029220 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:37.029187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:43.205633 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:43.205598 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:43.315317 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:43.315286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:43.406040 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:43.406003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:45.234289 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:45.234257 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:59.412334 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:17:59.412289 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:05.606244 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:05.606209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:05.722534 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:05.722472 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:05.851359 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:05.851326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:16.511812 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:16.511769 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:17.297673 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:17.297639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:24.078200 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:24.078170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:24.183423 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:24.183389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:24.278491 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:24.278461 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:24.378540 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:24.378418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:25.259129 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:25.259054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:25.360698 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:25.360665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:25.460589 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:25.460551 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:27.236435 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:27.236402 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:33.216217 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:33.216180 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:33.315053 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:33.315016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:33.936761 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:33.936725 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:40.564704 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:40.564671 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:40.661897 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:40.661863 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:40.913707 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:40.913624 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:41.213941 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:41.213907 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:41.430758 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:41.430730 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:44.323525 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:44.323480 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:44.420195 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:44.420160 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:44.570061 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:44.570028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:44.937732 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:44.937701 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:45.150783 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:45.150725 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:45.250991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:45.250908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:48.868104 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:48.868062 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:49.585157 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:49.585127 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:49.687092 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:49.687060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:50.078681 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:50.078646 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:56.097568 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:56.097536 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:56.198862 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:18:56.198832 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:07.022333 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:07.022285 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:11.542609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:11.542575 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:11.959773 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:11.959734 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:17.759747 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:17.759703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:17.819256 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:17.819221 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:18.053763 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:18.053679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:18.339497 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:18.339389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:18.444446 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:18.444413 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:18.547893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:18.547862 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:18.669027 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:18.668998 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:24.469616 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:24.469568 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:24.535673 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:24.535633 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:24.622462 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:24.622423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:24.722927 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:24.722830 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:24.876534 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:24.876473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:30.619723 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:30.619683 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:30.719955 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:30.719919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:37.705807 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:37.705759 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:38.012831 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.012730 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh"] Jul 22 02:19:38.013192 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013174 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" Jul 22 02:19:38.013321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013196 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" Jul 22 02:19:38.013321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013211 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" Jul 22 02:19:38.013321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013220 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" Jul 22 02:19:38.013321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013235 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" Jul 22 02:19:38.013321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013240 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" Jul 22 02:19:38.013321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013321 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" Jul 22 02:19:38.013637 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013332 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" Jul 22 02:19:38.013637 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013341 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" Jul 22 02:19:38.013637 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.013353 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4323198-3afb-4e63-b08d-985b70b86309" containerName="istio-proxy" Jul 22 02:19:38.016679 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.016656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.019151 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.019131 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4f16202b-openshift-default-dockercfg-vpf6s\"" Jul 22 02:19:38.030671 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.030645 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh"] Jul 22 02:19:38.044629 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.044606 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:38.085669 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085636 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqlm\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-kube-api-access-6xqlm\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.085853 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085679 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-istio-token\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.085853 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085699 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6542a765-0ac1-42c1-9911-1f10195eb668-istiod-ca-cert\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.085853 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-socket\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.085853 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-envoy\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.085853 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-data\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.086081 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-certs\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.086081 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085920 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6542a765-0ac1-42c1-9911-1f10195eb668-istio-podinfo\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.086081 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.085962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-credential-socket\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187095 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187058 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-istio-token\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187095 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6542a765-0ac1-42c1-9911-1f10195eb668-istiod-ca-cert\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187320 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-socket\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187320 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-envoy\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187320 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-data\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187485 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-certs\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187485 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187438 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6542a765-0ac1-42c1-9911-1f10195eb668-istio-podinfo\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187485 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-credential-socket\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187688 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187555 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-socket\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187688 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187588 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqlm\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-kube-api-access-6xqlm\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187688 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-data\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187843 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187734 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-certs\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187843 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187830 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-credential-socket\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.187955 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.187936 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6542a765-0ac1-42c1-9911-1f10195eb668-istiod-ca-cert\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.189609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.189582 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-envoy\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.189995 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.189976 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6542a765-0ac1-42c1-9911-1f10195eb668-istio-podinfo\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.196365 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.196347 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-istio-token\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.202116 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.202095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqlm\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-kube-api-access-6xqlm\") pod \"e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.260440 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.260392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:38.326948 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.326858 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:38.465910 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.465864 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh"] Jul 22 02:19:38.467873 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:19:38.467845 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6542a765_0ac1_42c1_9911_1f10195eb668.slice/crio-79eecbc16b469c61af4a44208c106efb506265b64e5c0ae1018b20dd6df3aa9d WatchSource:0}: Error finding container 79eecbc16b469c61af4a44208c106efb506265b64e5c0ae1018b20dd6df3aa9d: Status 404 returned error can't find the container with id 79eecbc16b469c61af4a44208c106efb506265b64e5c0ae1018b20dd6df3aa9d Jul 22 02:19:38.469970 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.469915 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:38.470059 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.470001 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:38.470059 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.470031 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:38.961153 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.961119 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" event={"ID":"6542a765-0ac1-42c1-9911-1f10195eb668","Type":"ContainerStarted","Data":"49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1"} Jul 22 02:19:38.961562 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.961169 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" event={"ID":"6542a765-0ac1-42c1-9911-1f10195eb668","Type":"ContainerStarted","Data":"79eecbc16b469c61af4a44208c106efb506265b64e5c0ae1018b20dd6df3aa9d"} Jul 22 02:19:38.982463 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:38.982405 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podStartSLOduration=1.982390034 podStartE2EDuration="1.982390034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:19:38.980885625 +0000 UTC m=+1937.920852900" watchObservedRunningTime="2026-07-22 02:19:38.982390034 +0000 UTC m=+1937.922357294" Jul 22 02:19:39.327591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:39.327487 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:39.332376 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:39.332346 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:39.965947 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:39.965920 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:39.966979 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:39.966962 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:40.952038 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:40.952006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:41.049987 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:41.049952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:41.178000 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:41.177967 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:41.740935 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:41.740901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:41.841916 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:41.841878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:45.499483 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:45.499450 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:54.967377 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:54.967294 2554 patch_prober.go:28] interesting pod/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 02:19:54.967377 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:54.967353 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 02:19:55.054256 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.054215 2554 generic.go:356] "Generic (PLEG): container finished" podID="6542a765-0ac1-42c1-9911-1f10195eb668" containerID="49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1" exitCode=0 Jul 22 02:19:55.054256 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.054259 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" event={"ID":"6542a765-0ac1-42c1-9911-1f10195eb668","Type":"ContainerDied","Data":"49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1"} Jul 22 02:19:55.054719 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.054700 2554 scope.go:117] "RemoveContainer" containerID="49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1" Jul 22 02:19:55.055716 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.055684 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:55.055809 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.055753 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:55.055809 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.055788 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:19:55.989041 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:55.989004 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:56.061989 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:56.061955 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" event={"ID":"6542a765-0ac1-42c1-9911-1f10195eb668","Type":"ContainerStarted","Data":"04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68"} Jul 22 02:19:56.327736 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:56.327633 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:19:56.327929 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:56.327900 2554 patch_prober.go:28] interesting pod/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 02:19:56.328006 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:56.327964 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 02:19:57.327396 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:57.327362 2554 patch_prober.go:28] interesting pod/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 02:19:57.327828 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:57.327419 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 02:19:58.328144 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:58.328103 2554 patch_prober.go:28] interesting pod/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 02:19:58.328555 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:58.328169 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 02:19:59.328037 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:59.328000 2554 patch_prober.go:28] interesting pod/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 02:19:59.328225 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:19:59.328061 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 02:20:00.331524 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:00.331482 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:20:00.331968 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:00.331781 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:20:00.332412 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:00.332396 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:20:03.682752 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:03.682721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:34.107657 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:34.107560 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:34.606732 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:34.606698 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:39.209658 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:39.209619 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:41.689324 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:41.689287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:46.720022 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:46.719978 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:52.775463 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:52.775418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:52.831359 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:20:52.831322 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:21.740029 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:21.739998 2554 scope.go:117] "RemoveContainer" containerID="958776c05e65f0efbb42b3ec923dc0215f40cd51b3de099e1567ce393bd51846" Jul 22 02:21:23.364218 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:23.364172 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:23.853992 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:23.853956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:28.946411 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:28.946376 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:29.045154 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:29.045117 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:29.605100 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:29.605064 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:29.705144 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:29.705107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:29.904240 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:29.904155 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh"] Jul 22 02:21:29.904398 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:29.904375 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" containerID="cri-o://04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68" gracePeriod=30 Jul 22 02:21:29.932813 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:29.932781 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:30.172093 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:30.172060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:30.334584 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:30.334548 2554 patch_prober.go:28] interesting pod/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 02:21:30.334744 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:30.334620 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 02:21:31.306503 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:31.306474 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:31.405394 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:31.405366 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:31.508453 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:31.508406 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:32.313111 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:32.313081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:32.412207 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:32.412152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:32.512109 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:32.512078 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:33.972285 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:33.972247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:35.168628 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.168606 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:21:35.296084 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296037 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-socket\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296124 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6542a765-0ac1-42c1-9911-1f10195eb668-istio-podinfo\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296159 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-istio-token\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296181 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-certs\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296256 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-data\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296287 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-envoy\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296618 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296319 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6542a765-0ac1-42c1-9911-1f10195eb668-istiod-ca-cert\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296618 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296332 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:35.296618 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296359 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-credential-socket\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296618 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296399 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xqlm\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-kube-api-access-6xqlm\") pod \"6542a765-0ac1-42c1-9911-1f10195eb668\" (UID: \"6542a765-0ac1-42c1-9911-1f10195eb668\") " Jul 22 02:21:35.296618 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296586 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:35.296893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296676 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6542a765-0ac1-42c1-9911-1f10195eb668-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:21:35.296893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296766 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.296893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296782 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6542a765-0ac1-42c1-9911-1f10195eb668-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.296893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296795 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.296893 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.296880 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:35.297331 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.297303 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-data" (OuterVolumeSpecName: "istio-data") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:35.298591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.298557 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-istio-token" (OuterVolumeSpecName: "istio-token") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:21:35.298717 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.298697 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-kube-api-access-6xqlm" (OuterVolumeSpecName: "kube-api-access-6xqlm") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "kube-api-access-6xqlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:21:35.298967 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.298941 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6542a765-0ac1-42c1-9911-1f10195eb668-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:21:35.298967 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.298948 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6542a765-0ac1-42c1-9911-1f10195eb668" (UID: "6542a765-0ac1-42c1-9911-1f10195eb668"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:21:35.397923 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.397887 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.397923 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.397915 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xqlm\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-kube-api-access-6xqlm\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.397923 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.397925 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6542a765-0ac1-42c1-9911-1f10195eb668-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.398159 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.397933 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6542a765-0ac1-42c1-9911-1f10195eb668-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.398159 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.397949 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.398159 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.397959 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6542a765-0ac1-42c1-9911-1f10195eb668-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:21:35.547927 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.547845 2554 generic.go:356] "Generic (PLEG): container finished" podID="6542a765-0ac1-42c1-9911-1f10195eb668" containerID="04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68" exitCode=0 Jul 22 02:21:35.547927 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.547892 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" Jul 22 02:21:35.548103 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.547925 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" event={"ID":"6542a765-0ac1-42c1-9911-1f10195eb668","Type":"ContainerDied","Data":"04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68"} Jul 22 02:21:35.548103 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.547982 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh" event={"ID":"6542a765-0ac1-42c1-9911-1f10195eb668","Type":"ContainerDied","Data":"79eecbc16b469c61af4a44208c106efb506265b64e5c0ae1018b20dd6df3aa9d"} Jul 22 02:21:35.548103 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.548005 2554 scope.go:117] "RemoveContainer" containerID="04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68" Jul 22 02:21:35.559271 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.559247 2554 scope.go:117] "RemoveContainer" containerID="49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1" Jul 22 02:21:35.568768 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.568750 2554 scope.go:117] "RemoveContainer" containerID="04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68" Jul 22 02:21:35.569042 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:21:35.569023 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68\": container with ID starting with 04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68 not found: ID does not exist" containerID="04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68" Jul 22 02:21:35.569109 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.569050 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68"} err="failed to get container status \"04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68\": rpc error: code = NotFound desc = could not find container \"04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68\": container with ID starting with 04e2beec330015093d1d0c89560f77358f3b7fd4d0deaf5bbb4d3bc0f7629d68 not found: ID does not exist" Jul 22 02:21:35.569109 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.569069 2554 scope.go:117] "RemoveContainer" containerID="49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1" Jul 22 02:21:35.569280 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:21:35.569259 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1\": container with ID starting with 49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1 not found: ID does not exist" containerID="49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1" Jul 22 02:21:35.569323 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.569286 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1"} err="failed to get container status \"49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1\": rpc error: code = NotFound desc = could not find container \"49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1\": container with ID starting with 49d73ef9bf2cf6362b6e724402418c99275af7ce61caf1a083553d2c382ea3c1 not found: ID does not exist" Jul 22 02:21:35.575050 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.575028 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh"] Jul 22 02:21:35.579613 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:35.579590 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4f16202b-openshift-default-6fbf9d6dc5-5djrh"] Jul 22 02:21:37.564969 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:37.564933 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" path="/var/lib/kubelet/pods/6542a765-0ac1-42c1-9911-1f10195eb668/volumes" Jul 22 02:21:39.962706 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:39.962648 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:40.065122 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:40.065079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:40.691040 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:40.691009 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:47.044819 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:47.044789 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:47.148651 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:47.148617 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:47.250978 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:47.250910 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:57.832946 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:57.832916 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:58.242006 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:21:58.241968 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:19.273333 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:19.273298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:21.687643 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:21.687617 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:22:21.694573 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:21.694550 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:22:25.398682 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:25.398646 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:25.499310 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:25.499280 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:25.760882 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:25.760854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:26.072936 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.072860 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9"] Jul 22 02:22:26.073222 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073210 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" Jul 22 02:22:26.073265 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073224 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77dc17f-1ba9-4864-b2e2-ca9443f87891" containerName="istio-proxy" Jul 22 02:22:26.073265 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073234 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" Jul 22 02:22:26.073265 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073239 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" Jul 22 02:22:26.073265 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073256 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" Jul 22 02:22:26.073265 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073262 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" Jul 22 02:22:26.073420 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073320 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" Jul 22 02:22:26.073420 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.073352 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6542a765-0ac1-42c1-9911-1f10195eb668" containerName="istio-proxy" Jul 22 02:22:26.076752 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.076734 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.079238 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.079217 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-196560-openshift-default-dockercfg-pxc89\"" Jul 22 02:22:26.091936 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.091913 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9"] Jul 22 02:22:26.102695 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.102668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:26.227671 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-socket\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227671 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-data\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227885 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227763 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istiod-ca-cert\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227885 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-podinfo\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227885 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227875 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-credential-socket\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227993 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227908 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-certs\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227993 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6mjw\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-kube-api-access-b6mjw\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.227993 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-envoy\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.228107 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.227999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-token\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328716 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-socket\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328716 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-data\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328716 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istiod-ca-cert\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-podinfo\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-credential-socket\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-certs\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6mjw\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-kube-api-access-b6mjw\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-envoy\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.328991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.328886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-token\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.329274 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.329090 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-socket\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.329274 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.329103 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-credential-socket\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.329274 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.329169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-certs\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.329274 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.329227 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-data\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.329563 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.329543 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istiod-ca-cert\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.331401 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.331382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-envoy\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.331621 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.331605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-podinfo\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.345168 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.345145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-token\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.347892 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.347868 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6mjw\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-kube-api-access-b6mjw\") pod \"e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.386643 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.386614 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:26.521652 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.521623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:26.530268 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.530241 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9"] Jul 22 02:22:26.531828 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:22:26.531804 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90de9ff4_865c_4f31_bf65_9b4b56c95b98.slice/crio-927487aacc6f7c44ebc7f47265eaae289c64217cb17ac7b4bc8cb8504ee35c92 WatchSource:0}: Error finding container 927487aacc6f7c44ebc7f47265eaae289c64217cb17ac7b4bc8cb8504ee35c92: Status 404 returned error can't find the container with id 927487aacc6f7c44ebc7f47265eaae289c64217cb17ac7b4bc8cb8504ee35c92 Jul 22 02:22:26.533817 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.533784 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:26.533900 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.533854 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:26.533900 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.533885 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:26.801156 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.801118 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" event={"ID":"90de9ff4-865c-4f31-bf65-9b4b56c95b98","Type":"ContainerStarted","Data":"1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832"} Jul 22 02:22:26.801348 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.801178 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" event={"ID":"90de9ff4-865c-4f31-bf65-9b4b56c95b98","Type":"ContainerStarted","Data":"927487aacc6f7c44ebc7f47265eaae289c64217cb17ac7b4bc8cb8504ee35c92"} Jul 22 02:22:26.824122 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:26.824062 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podStartSLOduration=0.824043439 podStartE2EDuration="824.043439ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:26.821209012 +0000 UTC m=+2105.761176273" watchObservedRunningTime="2026-07-22 02:22:26.824043439 +0000 UTC m=+2105.764010700" Jul 22 02:22:27.387530 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:27.387476 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:27.391936 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:27.391913 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:27.805816 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:27.805783 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:27.806790 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:27.806771 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:28.838850 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:28.838815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:28.941002 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:28.940963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:29.039671 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:29.039641 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:29.538455 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:29.538420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:29.638682 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:29.638649 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:29.702030 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:29.702002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:33.370059 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:33.370022 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:33.746907 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:33.746866 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:34.050488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.050405 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj"] Jul 22 02:22:34.054240 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.054218 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.056496 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.056477 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6708c8-openshift-default-dockercfg-h27ps\"" Jul 22 02:22:34.065204 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.065183 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj"] Jul 22 02:22:34.083650 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.083615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:34.209250 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209217 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-token\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209419 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-data\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209419 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209288 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9f01ed-96d9-4897-a616-ed2755584c1e-istiod-ca-cert\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209419 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209357 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-socket\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209419 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209400 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pvzk\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-kube-api-access-2pvzk\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209615 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209433 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-credential-socket\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209615 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-envoy\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209615 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209484 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-podinfo\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.209615 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.209566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-certs\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310228 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-envoy\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310228 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310178 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-podinfo\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310228 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-certs\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310534 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-token\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310534 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310273 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-data\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310534 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9f01ed-96d9-4897-a616-ed2755584c1e-istiod-ca-cert\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310534 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-socket\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvzk\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-kube-api-access-2pvzk\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-credential-socket\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310689 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-socket\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310931 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-certs\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.310931 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-credential-socket\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.311036 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.310984 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-data\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.311123 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.311101 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9f01ed-96d9-4897-a616-ed2755584c1e-istiod-ca-cert\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.313220 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.313197 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-envoy\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.313431 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.313412 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-podinfo\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.323480 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.323460 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-token\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.323658 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.323636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvzk\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-kube-api-access-2pvzk\") pod \"e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.366209 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.366180 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:34.386461 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.386420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:34.509968 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.509936 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj"] Jul 22 02:22:34.513068 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:22:34.513037 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9f01ed_96d9_4897_a616_ed2755584c1e.slice/crio-64acdd488f8740d283d49107f44e56092080a75bba6dbf282ba269cfc8a30c06 WatchSource:0}: Error finding container 64acdd488f8740d283d49107f44e56092080a75bba6dbf282ba269cfc8a30c06: Status 404 returned error can't find the container with id 64acdd488f8740d283d49107f44e56092080a75bba6dbf282ba269cfc8a30c06 Jul 22 02:22:34.515114 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.515082 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:34.515208 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.515162 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:34.515271 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.515214 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:34.846500 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.846415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" event={"ID":"fd9f01ed-96d9-4897-a616-ed2755584c1e","Type":"ContainerStarted","Data":"2da8a2713d88626bab34fe06e71fafcb32b0c12e4971f339889fc6580bfbe06c"} Jul 22 02:22:34.846800 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.846773 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" event={"ID":"fd9f01ed-96d9-4897-a616-ed2755584c1e","Type":"ContainerStarted","Data":"64acdd488f8740d283d49107f44e56092080a75bba6dbf282ba269cfc8a30c06"} Jul 22 02:22:34.866082 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:34.866013 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podStartSLOduration=0.865998085 podStartE2EDuration="865.998085ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:34.864252711 +0000 UTC m=+2113.804219963" watchObservedRunningTime="2026-07-22 02:22:34.865998085 +0000 UTC m=+2113.805965346" Jul 22 02:22:35.366488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:35.366444 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:35.371837 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:35.371809 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:35.851595 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:35.851555 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:35.852666 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:35.852647 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:36.843393 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:36.843358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:36.938865 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:36.938828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:37.016469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:37.016435 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:37.432448 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:37.432421 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:37.564888 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:37.564852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:37.666335 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:37.666305 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:41.407451 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:41.407413 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:43.847679 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:43.847636 2554 patch_prober.go:28] interesting pod/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 02:22:43.848074 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:43.847690 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 02:22:44.905347 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:44.905302 2554 generic.go:356] "Generic (PLEG): container finished" podID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerID="1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832" exitCode=0 Jul 22 02:22:44.905942 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:44.905491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" event={"ID":"90de9ff4-865c-4f31-bf65-9b4b56c95b98","Type":"ContainerDied","Data":"1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832"} Jul 22 02:22:44.906109 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:44.906083 2554 scope.go:117] "RemoveContainer" containerID="1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832" Jul 22 02:22:44.907643 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:44.907583 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:44.907745 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:44.907716 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:44.907807 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:44.907792 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:45.917401 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:45.917358 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" event={"ID":"90de9ff4-865c-4f31-bf65-9b4b56c95b98","Type":"ContainerStarted","Data":"09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5"} Jul 22 02:22:46.387260 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:46.387129 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:46.387883 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:46.387408 2554 patch_prober.go:28] interesting pod/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:22:46.387883 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:46.387592 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:22:47.387899 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:47.387851 2554 patch_prober.go:28] interesting pod/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:22:47.388408 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:47.387926 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:22:48.387759 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:48.387718 2554 patch_prober.go:28] interesting pod/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:22:48.388066 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:48.388027 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:22:49.387808 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:49.387760 2554 patch_prober.go:28] interesting pod/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 02:22:49.388020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:49.387829 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 02:22:50.353014 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:50.352976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:50.391215 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:50.391183 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:50.391482 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:50.391460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:50.392162 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:50.392144 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:22:50.435043 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:50.434988 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:51.127041 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.125552 2554 patch_prober.go:28] interesting pod/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:60234->10.133.0.46:15021: read: connection reset by peer" start-of-body= Jul 22 02:22:51.127041 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.125632 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:60234->10.133.0.46:15021: read: connection reset by peer" Jul 22 02:22:51.954996 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.954963 2554 generic.go:356] "Generic (PLEG): container finished" podID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerID="2da8a2713d88626bab34fe06e71fafcb32b0c12e4971f339889fc6580bfbe06c" exitCode=0 Jul 22 02:22:51.955374 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.955036 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" event={"ID":"fd9f01ed-96d9-4897-a616-ed2755584c1e","Type":"ContainerDied","Data":"2da8a2713d88626bab34fe06e71fafcb32b0c12e4971f339889fc6580bfbe06c"} Jul 22 02:22:51.955523 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.955490 2554 scope.go:117] "RemoveContainer" containerID="2da8a2713d88626bab34fe06e71fafcb32b0c12e4971f339889fc6580bfbe06c" Jul 22 02:22:51.956497 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.956469 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:51.956616 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.956560 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:51.956616 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:51.956594 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:22:52.961604 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:52.961565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" event={"ID":"fd9f01ed-96d9-4897-a616-ed2755584c1e","Type":"ContainerStarted","Data":"1d443020100a9f148d41fccb7215ac4ac6c4ee9fae5bba4ce507666a5e13e7f5"} Jul 22 02:22:53.367206 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:53.367104 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:53.367360 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:53.367319 2554 patch_prober.go:28] interesting pod/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 02:22:53.367402 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:53.367375 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 02:22:53.489716 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:53.489679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:54.367017 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:54.366984 2554 patch_prober.go:28] interesting pod/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 02:22:54.367454 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:54.367052 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 02:22:55.367142 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:55.367104 2554 patch_prober.go:28] interesting pod/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 02:22:55.367573 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:55.367161 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 02:22:56.367375 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:56.367340 2554 patch_prober.go:28] interesting pod/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 02:22:56.367794 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:56.367409 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 02:22:57.370712 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:57.370683 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:57.371106 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:57.371034 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:57.371631 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:57.371614 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:22:58.533106 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:58.533059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:58.633360 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:22:58.633287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:19.624613 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:23:19.624484 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:01.256697 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:01.256658 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:02.179872 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:02.179842 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:02.875398 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:02.875365 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:02.976472 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:02.976434 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:12.929788 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:12.929753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:17.433283 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:17.433248 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:17.857630 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:17.857491 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:24.125559 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:24.125523 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:24.227304 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:24.227273 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:24.388562 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:24.388452 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9"] Jul 22 02:24:24.388745 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:24.388720 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" containerID="cri-o://09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5" gracePeriod=30 Jul 22 02:24:24.415763 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:24.415733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:24.720432 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:24.720398 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:25.508850 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:25.508815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:25.609981 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:25.609946 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:29.649659 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.649636 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:24:29.705758 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705727 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-podinfo\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.705758 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705760 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-envoy\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705786 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-token\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705830 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-socket\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705881 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6mjw\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-kube-api-access-b6mjw\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705964 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istiod-ca-cert\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.705987 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-credential-socket\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706020 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706018 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-certs\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706331 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706053 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-data\") pod \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\" (UID: \"90de9ff4-865c-4f31-bf65-9b4b56c95b98\") " Jul 22 02:24:29.706331 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706185 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:29.706441 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706354 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.706441 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706365 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:29.706441 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706356 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:29.706859 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.706446 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:24:29.707259 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.707230 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-data" (OuterVolumeSpecName: "istio-data") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:29.708183 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.708148 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:24:29.708280 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.708204 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:29.708280 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.708214 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-kube-api-access-b6mjw" (OuterVolumeSpecName: "kube-api-access-b6mjw") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "kube-api-access-b6mjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:29.708426 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.708408 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-token" (OuterVolumeSpecName: "istio-token") pod "90de9ff4-865c-4f31-bf65-9b4b56c95b98" (UID: "90de9ff4-865c-4f31-bf65-9b4b56c95b98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:29.807823 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807781 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6mjw\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-kube-api-access-b6mjw\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.807823 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807812 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.807823 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807821 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.807823 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807830 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.808089 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807842 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.808089 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807854 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.808089 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807864 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:29.808089 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:29.807876 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90de9ff4-865c-4f31-bf65-9b4b56c95b98-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:30.458121 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.458084 2554 generic.go:356] "Generic (PLEG): container finished" podID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerID="09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5" exitCode=0 Jul 22 02:24:30.458299 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.458145 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" Jul 22 02:24:30.458299 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.458167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" event={"ID":"90de9ff4-865c-4f31-bf65-9b4b56c95b98","Type":"ContainerDied","Data":"09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5"} Jul 22 02:24:30.458299 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.458221 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9" event={"ID":"90de9ff4-865c-4f31-bf65-9b4b56c95b98","Type":"ContainerDied","Data":"927487aacc6f7c44ebc7f47265eaae289c64217cb17ac7b4bc8cb8504ee35c92"} Jul 22 02:24:30.458299 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.458243 2554 scope.go:117] "RemoveContainer" containerID="09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5" Jul 22 02:24:30.467871 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.467854 2554 scope.go:117] "RemoveContainer" containerID="1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832" Jul 22 02:24:30.476131 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.476113 2554 scope.go:117] "RemoveContainer" containerID="09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5" Jul 22 02:24:30.476389 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:24:30.476372 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5\": container with ID starting with 09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5 not found: ID does not exist" containerID="09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5" Jul 22 02:24:30.476428 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.476399 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5"} err="failed to get container status \"09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5\": rpc error: code = NotFound desc = could not find container \"09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5\": container with ID starting with 09b51cd9af7d4e5ce225ae22dff5f23b85d3a39e6405d458f7286ff2fc9a14b5 not found: ID does not exist" Jul 22 02:24:30.476428 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.476418 2554 scope.go:117] "RemoveContainer" containerID="1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832" Jul 22 02:24:30.476697 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:24:30.476679 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832\": container with ID starting with 1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832 not found: ID does not exist" containerID="1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832" Jul 22 02:24:30.476740 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.476708 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832"} err="failed to get container status \"1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832\": rpc error: code = NotFound desc = could not find container \"1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832\": container with ID starting with 1cc3dbf51437abc18af7df3911c5250960a3930567cac1abd3760619b9c5f832 not found: ID does not exist" Jul 22 02:24:30.480064 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.480042 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9"] Jul 22 02:24:30.486942 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:30.486921 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-196560-openshift-default-5f98f66695-6gcr9"] Jul 22 02:24:31.566619 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:31.566579 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" path="/var/lib/kubelet/pods/90de9ff4-865c-4f31-bf65-9b4b56c95b98/volumes" Jul 22 02:24:35.469108 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:35.469066 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:38.801794 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:38.801756 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:39.900471 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:39.900437 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:40.324933 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:40.324903 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:46.121590 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:46.121551 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:46.197803 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:46.197761 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:46.410324 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:46.410243 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj"] Jul 22 02:24:46.410485 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:46.410464 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" containerID="cri-o://1d443020100a9f148d41fccb7215ac4ac6c4ee9fae5bba4ce507666a5e13e7f5" gracePeriod=30 Jul 22 02:24:46.439986 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:46.439953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:46.723487 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:46.723455 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:47.101439 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:47.101346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:47.484386 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:47.484354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:47.736992 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:47.736891 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:50.430684 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:50.430647 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:50.544938 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:50.544908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:50.648734 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:50.648702 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:50.749302 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:50.749213 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:51.078560 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.078454 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:51.178879 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.178850 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:51.570280 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.570249 2554 generic.go:356] "Generic (PLEG): container finished" podID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerID="1d443020100a9f148d41fccb7215ac4ac6c4ee9fae5bba4ce507666a5e13e7f5" exitCode=0 Jul 22 02:24:51.570804 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.570285 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" event={"ID":"fd9f01ed-96d9-4897-a616-ed2755584c1e","Type":"ContainerDied","Data":"1d443020100a9f148d41fccb7215ac4ac6c4ee9fae5bba4ce507666a5e13e7f5"} Jul 22 02:24:51.570804 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.570351 2554 scope.go:117] "RemoveContainer" containerID="2da8a2713d88626bab34fe06e71fafcb32b0c12e4971f339889fc6580bfbe06c" Jul 22 02:24:51.673053 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.672999 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:24:51.709122 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709093 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-credential-socket\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709160 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-data\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709187 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pvzk\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-kube-api-access-2pvzk\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709209 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-podinfo\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709238 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-token\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709260 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9f01ed-96d9-4897-a616-ed2755584c1e-istiod-ca-cert\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709281 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-envoy\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709638 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709400 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:51.709717 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709657 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-socket\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.709771 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.709737 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-certs\") pod \"fd9f01ed-96d9-4897-a616-ed2755584c1e\" (UID: \"fd9f01ed-96d9-4897-a616-ed2755584c1e\") " Jul 22 02:24:51.710569 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.710535 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:51.710759 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.710734 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9f01ed-96d9-4897-a616-ed2755584c1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:24:51.710980 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.710958 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.711055 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.710988 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.711201 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.711170 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:51.711370 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.711337 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:51.713539 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.712896 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:51.713639 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.713608 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:24:51.720117 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.720083 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-kube-api-access-2pvzk" (OuterVolumeSpecName: "kube-api-access-2pvzk") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "kube-api-access-2pvzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:51.720964 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.720940 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd9f01ed-96d9-4897-a616-ed2755584c1e" (UID: "fd9f01ed-96d9-4897-a616-ed2755584c1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:51.811897 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811858 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.811897 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811896 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9f01ed-96d9-4897-a616-ed2755584c1e-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.812166 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811910 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.812166 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811923 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.812166 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811935 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.812166 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811947 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pvzk\" (UniqueName: \"kubernetes.io/projected/fd9f01ed-96d9-4897-a616-ed2755584c1e-kube-api-access-2pvzk\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:51.812166 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:51.811960 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9f01ed-96d9-4897-a616-ed2755584c1e-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:24:52.576591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:52.576557 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" event={"ID":"fd9f01ed-96d9-4897-a616-ed2755584c1e","Type":"ContainerDied","Data":"64acdd488f8740d283d49107f44e56092080a75bba6dbf282ba269cfc8a30c06"} Jul 22 02:24:52.576591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:52.576576 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj" Jul 22 02:24:52.577077 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:52.576611 2554 scope.go:117] "RemoveContainer" containerID="1d443020100a9f148d41fccb7215ac4ac6c4ee9fae5bba4ce507666a5e13e7f5" Jul 22 02:24:52.599030 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:52.599006 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj"] Jul 22 02:24:52.602694 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:52.602673 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6708c8-openshift-default-54479b5b8c-pplcj"] Jul 22 02:24:53.564578 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:53.564541 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" path="/var/lib/kubelet/pods/fd9f01ed-96d9-4897-a616-ed2755584c1e/volumes" Jul 22 02:24:54.830143 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:54.830114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:55.453469 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.453438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:55.694048 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694017 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb"] Jul 22 02:24:55.694531 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694494 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" Jul 22 02:24:55.694624 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694534 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" Jul 22 02:24:55.694624 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694546 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" Jul 22 02:24:55.694624 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694555 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" Jul 22 02:24:55.694624 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694593 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" Jul 22 02:24:55.694624 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694603 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" Jul 22 02:24:55.694847 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694693 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" Jul 22 02:24:55.694847 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694706 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90de9ff4-865c-4f31-bf65-9b4b56c95b98" containerName="istio-proxy" Jul 22 02:24:55.694847 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694720 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" Jul 22 02:24:55.694847 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.694730 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" Jul 22 02:24:55.697891 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.697872 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.701392 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.701370 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-da3c46-openshift-default-dockercfg-s497d\"" Jul 22 02:24:55.713000 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.712979 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb"] Jul 22 02:24:55.725724 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.725696 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:55.748270 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748235 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-credential-socket\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748423 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn7qg\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-kube-api-access-bn7qg\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748423 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748346 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-socket\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748423 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istiod-ca-cert\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748636 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-certs\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748636 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-data\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748636 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-podinfo\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748636 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748593 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-envoy\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.748795 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.748644 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-token\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.849882 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.849837 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-envoy\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850383 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.849902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-token\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850383 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.849942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-credential-socket\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850383 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7qg\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-kube-api-access-bn7qg\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850383 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850167 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-socket\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850383 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istiod-ca-cert\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850383 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-certs\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850734 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850389 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-credential-socket\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850734 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-data\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850734 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850472 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-podinfo\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850734 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850559 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-socket\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850939 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850764 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-data\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850939 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850773 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-certs\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.850939 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.850924 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istiod-ca-cert\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.852499 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.852475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-envoy\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.853283 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.853259 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-podinfo\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.865124 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.865097 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-token\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.865275 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.865256 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn7qg\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-kube-api-access-bn7qg\") pod \"e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:55.902369 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:55.902340 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:56.007493 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.007387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:56.148866 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.148843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb"] Jul 22 02:24:56.150701 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:24:56.150673 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95f7395_64b5_4df5_9e6f_26b7b4f0ea2f.slice/crio-7a92291e192776b1122516b5b6bf7eb1697c9f1cafcb26faa52c2fee8255d966 WatchSource:0}: Error finding container 7a92291e192776b1122516b5b6bf7eb1697c9f1cafcb26faa52c2fee8255d966: Status 404 returned error can't find the container with id 7a92291e192776b1122516b5b6bf7eb1697c9f1cafcb26faa52c2fee8255d966 Jul 22 02:24:56.152767 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.152737 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:24:56.152832 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.152801 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:24:56.152870 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.152830 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:24:56.599500 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.599460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" event={"ID":"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f","Type":"ContainerStarted","Data":"f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced"} Jul 22 02:24:56.599720 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.599541 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" event={"ID":"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f","Type":"ContainerStarted","Data":"7a92291e192776b1122516b5b6bf7eb1697c9f1cafcb26faa52c2fee8255d966"} Jul 22 02:24:56.621554 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:56.619182 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podStartSLOduration=1.6191613230000002 podStartE2EDuration="1.619161323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:56.617658528 +0000 UTC m=+2255.557625814" watchObservedRunningTime="2026-07-22 02:24:56.619161323 +0000 UTC m=+2255.559128584" Jul 22 02:24:57.008142 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:57.008109 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:57.013284 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:57.013260 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:57.604519 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:57.604485 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:57.605374 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:57.605356 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:24:58.746159 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:24:58.746125 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:00.034870 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:00.034836 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:03.153382 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:03.153344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:11.886986 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:11.886956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:11.987230 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:11.987180 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:13.646688 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:13.646635 2554 patch_prober.go:28] interesting pod/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 22 02:25:13.647094 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:13.646693 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 22 02:25:14.691895 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:14.691859 2554 generic.go:356] "Generic (PLEG): container finished" podID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerID="f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced" exitCode=0 Jul 22 02:25:14.692299 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:14.691909 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" event={"ID":"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f","Type":"ContainerDied","Data":"f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced"} Jul 22 02:25:14.692341 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:14.692310 2554 scope.go:117] "RemoveContainer" containerID="f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced" Jul 22 02:25:14.693307 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:14.693274 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:25:14.693467 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:14.693359 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:25:14.693467 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:14.693409 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:25:15.701883 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:15.701826 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" event={"ID":"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f","Type":"ContainerStarted","Data":"55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de"} Jul 22 02:25:16.008358 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:16.008248 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:25:16.008574 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:16.008379 2554 patch_prober.go:28] interesting pod/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:25:16.008574 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:16.008423 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:25:17.008416 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:17.008367 2554 patch_prober.go:28] interesting pod/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:25:17.008946 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:17.008443 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:25:18.008492 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:18.008448 2554 patch_prober.go:28] interesting pod/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:25:18.009082 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:18.009048 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:25:19.008652 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:19.008601 2554 patch_prober.go:28] interesting pod/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 02:25:19.009179 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:19.008691 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 02:25:20.011716 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:20.011662 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:25:20.012207 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:20.012186 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:25:20.012927 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:20.012909 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:25:20.289076 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:20.288984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:20.394102 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:20.394073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:21.985655 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:21.985621 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:22.086190 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:22.086099 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:27.258841 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:27.258800 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:31.550410 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:31.550375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:31.956870 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:31.956829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:35.282043 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:35.281999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:35.340770 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:35.340737 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:37.802093 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:37.802064 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:37.903388 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:37.903356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:38.177249 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:38.177224 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:38.366410 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:38.366376 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:39.483654 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:39.483618 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:39.591028 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:39.590994 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:54.038300 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:54.038257 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:58.581569 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:58.581538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:59.006618 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:25:59.006584 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:05.294386 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:05.294351 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:05.397609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:05.397579 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:05.568212 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:05.568131 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb"] Jul 22 02:26:05.568369 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:05.568315 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" containerID="cri-o://55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de" gracePeriod=30 Jul 22 02:26:05.595024 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:05.594972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:05.915294 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:05.915269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:06.292564 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.292465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:06.608860 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.608775 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt"] Jul 22 02:26:06.609203 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.609132 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" Jul 22 02:26:06.609203 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.609143 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9f01ed-96d9-4897-a616-ed2755584c1e" containerName="istio-proxy" Jul 22 02:26:06.612324 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.612307 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.614830 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.614806 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9d0056-openshift-default-dockercfg-9cc4z\"" Jul 22 02:26:06.625233 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.625207 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt"] Jul 22 02:26:06.633928 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.633904 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:06.693025 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.692980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-data\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693226 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-credential-socket\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693226 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrc7f\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-kube-api-access-jrc7f\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693226 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-socket\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693400 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-istio-token\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693400 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ca0fb7-1664-4396-a623-f6e655f17027-istiod-ca-cert\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693400 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693371 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ca0fb7-1664-4396-a623-f6e655f17027-istio-podinfo\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693493 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-certs\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.693591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.693550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-envoy\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794561 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ca0fb7-1664-4396-a623-f6e655f17027-istio-podinfo\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794754 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-certs\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794754 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-envoy\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794754 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-data\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794754 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-credential-socket\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794754 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794700 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrc7f\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-kube-api-access-jrc7f\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.794754 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-socket\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795055 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-istio-token\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795055 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.794797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ca0fb7-1664-4396-a623-f6e655f17027-istiod-ca-cert\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795164 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.795094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-data\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795164 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.795138 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-certs\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795264 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.795205 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-credential-socket\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795453 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.795432 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-socket\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.795536 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.795495 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ca0fb7-1664-4396-a623-f6e655f17027-istiod-ca-cert\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.797615 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.797591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-envoy\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.797833 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.797816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ca0fb7-1664-4396-a623-f6e655f17027-istio-podinfo\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.803627 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.803602 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-istio-token\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.803842 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.803827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrc7f\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-kube-api-access-jrc7f\") pod \"e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:06.923324 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:06.923293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:07.078871 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.078845 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt"] Jul 22 02:26:07.081063 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:26:07.081037 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ca0fb7_1664_4396_a623_f6e655f17027.slice/crio-98c6071c57477497aa997b41ae3e597d66504d46886df21173d9f48ac8c4ed86 WatchSource:0}: Error finding container 98c6071c57477497aa997b41ae3e597d66504d46886df21173d9f48ac8c4ed86: Status 404 returned error can't find the container with id 98c6071c57477497aa997b41ae3e597d66504d46886df21173d9f48ac8c4ed86 Jul 22 02:26:07.083217 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.083180 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:07.083291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.083252 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:07.083291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.083285 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:07.253231 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.253138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:07.977474 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.977437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" event={"ID":"37ca0fb7-1664-4396-a623-f6e655f17027","Type":"ContainerStarted","Data":"aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6"} Jul 22 02:26:07.977921 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:07.977496 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" event={"ID":"37ca0fb7-1664-4396-a623-f6e655f17027","Type":"ContainerStarted","Data":"98c6071c57477497aa997b41ae3e597d66504d46886df21173d9f48ac8c4ed86"} Jul 22 02:26:08.008889 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:08.008837 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podStartSLOduration=2.008821414 podStartE2EDuration="2.008821414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:08.007122937 +0000 UTC m=+2326.947090198" watchObservedRunningTime="2026-07-22 02:26:08.008821414 +0000 UTC m=+2326.948788675" Jul 22 02:26:08.924280 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:08.924242 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:08.929090 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:08.929063 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:08.981871 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:08.981826 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:08.982601 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:08.982581 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:10.019290 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.019262 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:10.118717 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.118686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:10.215912 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.215878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:10.491498 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.491467 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:10.743291 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.743201 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:10.822139 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.822116 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:26:10.853790 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.853747 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:10.937574 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937538 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istiod-ca-cert\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.937762 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937581 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-credential-socket\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.937762 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937600 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-data\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.937762 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937636 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-podinfo\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.937762 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937661 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-certs\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.937762 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937754 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-envoy\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.938032 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937781 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-token\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.938032 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937835 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-socket\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.938032 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937886 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn7qg\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-kube-api-access-bn7qg\") pod \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\" (UID: \"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f\") " Jul 22 02:26:10.938032 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.937872 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:26:10.938032 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938023 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:26:10.938364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938137 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:26:10.938364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938282 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:26:10.938364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938312 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:10.938364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938330 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:10.938364 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938343 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:10.938819 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.938526 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:26:10.940120 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.940091 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:26:10.940233 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.940115 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:26:10.940574 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.940551 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:26:10.940653 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.940570 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-kube-api-access-bn7qg" (OuterVolumeSpecName: "kube-api-access-bn7qg") pod "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" (UID: "b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f"). InnerVolumeSpecName "kube-api-access-bn7qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:26:10.994225 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.994144 2554 generic.go:356] "Generic (PLEG): container finished" podID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerID="55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de" exitCode=0 Jul 22 02:26:10.994225 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.994190 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" Jul 22 02:26:10.994447 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.994229 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" event={"ID":"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f","Type":"ContainerDied","Data":"55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de"} Jul 22 02:26:10.994447 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.994301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb" event={"ID":"b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f","Type":"ContainerDied","Data":"7a92291e192776b1122516b5b6bf7eb1697c9f1cafcb26faa52c2fee8255d966"} Jul 22 02:26:10.994447 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:10.994336 2554 scope.go:117] "RemoveContainer" containerID="55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de" Jul 22 02:26:11.004031 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.004015 2554 scope.go:117] "RemoveContainer" containerID="f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced" Jul 22 02:26:11.012378 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.012359 2554 scope.go:117] "RemoveContainer" containerID="55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de" Jul 22 02:26:11.012648 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:26:11.012625 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de\": container with ID starting with 55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de not found: ID does not exist" containerID="55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de" Jul 22 02:26:11.012740 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.012654 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de"} err="failed to get container status \"55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de\": rpc error: code = NotFound desc = could not find container \"55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de\": container with ID starting with 55ed9531b2e1f74a33a40baf6316afb7189ada6f22eb7bec4f59931468f9c7de not found: ID does not exist" Jul 22 02:26:11.012740 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.012677 2554 scope.go:117] "RemoveContainer" containerID="f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced" Jul 22 02:26:11.012927 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:26:11.012912 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced\": container with ID starting with f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced not found: ID does not exist" containerID="f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced" Jul 22 02:26:11.012971 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.012931 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced"} err="failed to get container status \"f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced\": rpc error: code = NotFound desc = could not find container \"f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced\": container with ID starting with f802cdb2cad88e25b031658df693e71379615caf422f3310ea25927bee22fced not found: ID does not exist" Jul 22 02:26:11.022183 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.022160 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb"] Jul 22 02:26:11.034951 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.034927 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-da3c46-openshift-default-85bdcf7b9f-wd5xb"] Jul 22 02:26:11.039144 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.039127 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:11.039213 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.039146 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:11.039213 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.039154 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:11.039213 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.039164 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:11.039213 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.039171 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:11.039213 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.039179 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn7qg\" (UniqueName: \"kubernetes.io/projected/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f-kube-api-access-bn7qg\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:26:11.565420 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:11.565385 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" path="/var/lib/kubelet/pods/b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f/volumes" Jul 22 02:26:14.614125 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:14.614010 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:14.994361 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:14.994313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:15.442079 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:15.442043 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:16.195718 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:16.195680 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:19.035579 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:19.035549 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:19.233328 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:19.233292 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:19.518991 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:19.518965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:20.023274 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:20.023240 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:20.239902 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:20.239869 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:20.367599 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:20.367503 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:23.459596 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:23.459563 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:23.982868 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:23.982832 2554 patch_prober.go:28] interesting pod/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 02:26:23.983037 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:23.982901 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 02:26:24.071478 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:24.071447 2554 generic.go:356] "Generic (PLEG): container finished" podID="37ca0fb7-1664-4396-a623-f6e655f17027" containerID="aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6" exitCode=0 Jul 22 02:26:24.071660 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:24.071534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" event={"ID":"37ca0fb7-1664-4396-a623-f6e655f17027","Type":"ContainerDied","Data":"aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6"} Jul 22 02:26:24.071948 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:24.071932 2554 scope.go:117] "RemoveContainer" containerID="aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6" Jul 22 02:26:24.072967 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:24.072938 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:24.073048 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:24.073029 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:24.073088 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:24.073078 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 22 02:26:25.079235 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:25.079198 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" event={"ID":"37ca0fb7-1664-4396-a623-f6e655f17027","Type":"ContainerStarted","Data":"2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6"} Jul 22 02:26:25.924355 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:25.924312 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:25.924627 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:25.924605 2554 patch_prober.go:28] interesting pod/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 02:26:25.924681 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:25.924658 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 02:26:26.924619 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:26.924579 2554 patch_prober.go:28] interesting pod/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 02:26:26.925030 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:26.924642 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 02:26:27.924334 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:27.924299 2554 patch_prober.go:28] interesting pod/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 02:26:27.924538 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:27.924351 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 02:26:28.924239 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:28.924207 2554 patch_prober.go:28] interesting pod/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 02:26:28.924683 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:28.924258 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 02:26:29.928214 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:29.928183 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:29.928755 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:29.928730 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:29.929384 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:29.929364 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:26:30.092449 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:30.092419 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:30.184743 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:30.184649 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:31.733751 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:31.733717 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:31.837086 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:31.837054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:33.744803 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:33.744768 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:41.369903 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:41.369858 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:41.473347 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:41.473312 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:49.714041 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:26:49.714008 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:07.601917 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:07.601884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:15.575365 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:15.575331 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:21.717901 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:21.717874 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:27:21.729532 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:21.729492 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:27:43.601199 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:43.601166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:43.700932 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:43.700889 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:45.799809 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:27:45.799774 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:26.051739 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:28:26.051703 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:29:07.658847 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:29:07.658809 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:29:08.679764 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:29:08.679726 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:29:25.433198 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:29:25.433162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:29:47.291695 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:29:47.291654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:28.395901 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:30:28.395854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:29.793321 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:30:29.793277 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:55.313415 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:30:55.313372 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:11.199018 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:11.198975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:20.768912 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:20.768856 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:20.871011 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:20.870980 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:31.011219 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:31.011186 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:31.111784 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:31.111749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:32.663406 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:32.663358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:32.764598 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:32.764560 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:42.334632 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:42.334599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:42.430141 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:42.430102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:57.214836 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:57.214803 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:58.158984 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:31:58.158929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:18.065248 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:18.065182 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:18.172398 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:18.172360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:21.749693 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:21.749668 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:32:21.759281 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:21.759260 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:32:28.025432 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:28.025399 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:32.593492 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:32.593457 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:33.055454 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:33.055415 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:40.058598 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:40.058563 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:40.157895 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:40.157859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:40.328301 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:40.328221 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt"] Jul 22 02:32:40.328537 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:40.328494 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" containerID="cri-o://2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6" gracePeriod=30 Jul 22 02:32:40.344583 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:40.344556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:40.663765 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:40.663675 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:41.457718 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:41.457686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:41.560990 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:41.560941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:44.930969 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:44.930939 2554 patch_prober.go:28] interesting pod/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 02:32:44.931358 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:44.930995 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 02:32:45.585399 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.585378 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:32:45.709830 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.709796 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ca0fb7-1664-4396-a623-f6e655f17027-istio-podinfo\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710025 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.709846 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-istio-token\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710025 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.709883 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-socket\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710025 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.709995 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ca0fb7-1664-4396-a623-f6e655f17027-istiod-ca-cert\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710193 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710035 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-data\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710193 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710089 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrc7f\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-kube-api-access-jrc7f\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710193 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710120 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-certs\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710193 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710149 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-envoy\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.710193 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710159 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:32:45.710193 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710193 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-credential-socket\") pod \"37ca0fb7-1664-4396-a623-f6e655f17027\" (UID: \"37ca0fb7-1664-4396-a623-f6e655f17027\") " Jul 22 02:32:45.711696 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.710912 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37ca0fb7-1664-4396-a623-f6e655f17027-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:32:45.711696 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.711012 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-data" (OuterVolumeSpecName: "istio-data") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:32:45.711696 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.711095 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.711696 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.711115 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ca0fb7-1664-4396-a623-f6e655f17027-istiod-ca-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.711696 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.711277 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:32:45.712304 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.712270 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:32:45.718685 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.718234 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37ca0fb7-1664-4396-a623-f6e655f17027-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 02:32:45.718685 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.718644 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-kube-api-access-jrc7f" (OuterVolumeSpecName: "kube-api-access-jrc7f") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "kube-api-access-jrc7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:32:45.718685 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.718650 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:32:45.718929 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.718909 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-istio-token" (OuterVolumeSpecName: "istio-token") pod "37ca0fb7-1664-4396-a623-f6e655f17027" (UID: "37ca0fb7-1664-4396-a623-f6e655f17027"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:32:45.812104 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812066 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ca0fb7-1664-4396-a623-f6e655f17027-istio-podinfo\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.812104 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812097 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-istio-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.812104 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812110 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-data\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.812349 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812124 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrc7f\" (UniqueName: \"kubernetes.io/projected/37ca0fb7-1664-4396-a623-f6e655f17027-kube-api-access-jrc7f\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.812349 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812137 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-workload-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.812349 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812148 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-istio-envoy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.812349 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.812159 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ca0fb7-1664-4396-a623-f6e655f17027-credential-socket\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jul 22 02:32:45.956567 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.956500 2554 generic.go:356] "Generic (PLEG): container finished" podID="37ca0fb7-1664-4396-a623-f6e655f17027" containerID="2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6" exitCode=0 Jul 22 02:32:45.956996 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.956573 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" Jul 22 02:32:45.956996 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.956540 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" event={"ID":"37ca0fb7-1664-4396-a623-f6e655f17027","Type":"ContainerDied","Data":"2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6"} Jul 22 02:32:45.956996 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.956667 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt" event={"ID":"37ca0fb7-1664-4396-a623-f6e655f17027","Type":"ContainerDied","Data":"98c6071c57477497aa997b41ae3e597d66504d46886df21173d9f48ac8c4ed86"} Jul 22 02:32:45.956996 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.956690 2554 scope.go:117] "RemoveContainer" containerID="2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6" Jul 22 02:32:45.966239 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.966222 2554 scope.go:117] "RemoveContainer" containerID="aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6" Jul 22 02:32:45.974594 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.974577 2554 scope.go:117] "RemoveContainer" containerID="2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6" Jul 22 02:32:45.974833 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:32:45.974813 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6\": container with ID starting with 2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6 not found: ID does not exist" containerID="2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6" Jul 22 02:32:45.974882 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.974861 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6"} err="failed to get container status \"2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6\": rpc error: code = NotFound desc = could not find container \"2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6\": container with ID starting with 2c6afe941d25ed73b9ea68b1989d234bf8c6818115d8d0600c24086d7f7a07e6 not found: ID does not exist" Jul 22 02:32:45.974924 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.974885 2554 scope.go:117] "RemoveContainer" containerID="aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6" Jul 22 02:32:45.975122 ip-10-0-143-108 kubenswrapper[2554]: E0722 02:32:45.975106 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6\": container with ID starting with aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6 not found: ID does not exist" containerID="aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6" Jul 22 02:32:45.975154 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.975128 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6"} err="failed to get container status \"aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6\": rpc error: code = NotFound desc = could not find container \"aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6\": container with ID starting with aa8edb66b790c8530ab52408d8e9bec025b6c405c80e42077df8673b30a6e3a6 not found: ID does not exist" Jul 22 02:32:45.982064 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.982042 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt"] Jul 22 02:32:45.985804 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:45.985782 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9d0056-openshift-default-748c6899f9-rxxgt"] Jul 22 02:32:47.564711 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:47.564669 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" path="/var/lib/kubelet/pods/37ca0fb7-1664-4396-a623-f6e655f17027/volumes" Jul 22 02:32:51.510238 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:51.510203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:55.976177 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:55.976142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:56.400129 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:32:56.400046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:02.872391 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:02.872359 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:02.977608 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:02.977578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:03.226668 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:03.226642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:03.509891 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:03.509797 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:10.509845 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:10.509804 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db775cb8b-4bxdn_1d2bc59d-fef7-4602-a6a1-fb19c382c20a/manager/0.log" Jul 22 02:33:10.659467 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:10.659440 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6w8qc_99bc3c58-35d8-44f7-99a5-c8d7add2e286/server/0.log" Jul 22 02:33:10.933218 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:10.933197 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-9bccm_7da8827e-d16d-447e-bec1-03cd59fffb2b/copy-manifests/0.log" Jul 22 02:33:10.943428 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:10.943405 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-9bccm_7da8827e-d16d-447e-bec1-03cd59fffb2b/manager/0.log" Jul 22 02:33:11.789040 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:11.789011 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744760-fsbrs_c18190dd-6868-4437-ba3b-82ff26119871/cleanup/0.log" Jul 22 02:33:15.111936 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:15.111899 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cgn2q_4322b333-4774-4d0a-900d-49555f2916be/istio-proxy/0.log" Jul 22 02:33:15.247932 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:15.247900 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t22gn_0ec17ba8-4a4d-47da-a57d-540962ada1d8/discovery/0.log" Jul 22 02:33:15.769139 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:15.769094 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tqmbd_742fb4d8-ced1-4e81-a4fe-af70acd8a987/payload-pre-processing/0.log" Jul 22 02:33:16.021382 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:16.021304 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fd7458cb-mzkb2_0893a9f4-2552-4b8e-af5a-2e43e0a24618/router/0.log" Jul 22 02:33:16.519030 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:16.519004 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jk66c_ac9a1482-fe0b-472b-9d71-2d095c122bae/main/0.log" Jul 22 02:33:16.766488 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:16.766453 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh5pkn_53745232-12e3-4e40-891d-2642dcacdc61/main/0.log" Jul 22 02:33:16.896737 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:16.896657 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tzrxj_a378c638-b3c5-4f28-af1e-38793a8ef7e5/main/0.log" Jul 22 02:33:23.192458 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:23.192424 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:23.284727 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:23.284693 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:25.966651 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:25.966615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9p4g6_3a104096-a728-4057-b64c-19adf6c03586/global-pull-secret-syncer/0.log" Jul 22 02:33:26.145267 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:26.145232 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" Jul 22 02:33:26.322846 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:26.322772 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-108.ec2.internal_004580757f306e7a3c43a8130fcf2570/haproxy/0.log" Jul 22 02:33:27.048319 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:27.048284 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxx9x_aa8f0250-d592-456e-b0a8-26a7e9277844/konnectivity-agent/0.log" limit=1024 Jul 22 02:33:33.414256 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:33.414229 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-2jqm6_06c8ad63-a743-4e4f-beaf-68f6f46d2138/cluster-monitoring-operator/0.log" Jul 22 02:33:33.962307 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:33.962277 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zg7h2_25c6b2e3-09dd-48ad-9a57-5acbb839eec6/node-exporter/0.log" Jul 22 02:33:34.001878 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:34.001842 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zg7h2_25c6b2e3-09dd-48ad-9a57-5acbb839eec6/kube-rbac-proxy/0.log" Jul 22 02:33:34.064442 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:34.064418 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zg7h2_25c6b2e3-09dd-48ad-9a57-5acbb839eec6/init-textfile/0.log" Jul 22 02:33:34.592778 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:34.592746 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d55f94558-kfff8_481f8af7-3e6b-43d4-a57d-1024af917dca/telemeter-client/0.log" Jul 22 02:33:34.625351 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:34.625327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d55f94558-kfff8_481f8af7-3e6b-43d4-a57d-1024af917dca/reload/0.log" Jul 22 02:33:34.650640 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:34.650615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d55f94558-kfff8_481f8af7-3e6b-43d4-a57d-1024af917dca/kube-rbac-proxy/0.log" Jul 22 02:33:35.709247 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709212 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz"] Jul 22 02:33:35.709644 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709571 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" Jul 22 02:33:35.709644 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709583 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" Jul 22 02:33:35.709644 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709595 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" Jul 22 02:33:35.709644 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709603 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" Jul 22 02:33:35.709644 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709610 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" Jul 22 02:33:35.709644 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709616 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" Jul 22 02:33:35.709829 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709685 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" Jul 22 02:33:35.709829 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709693 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b95f7395-64b5-4df5-9e6f-26b7b4f0ea2f" containerName="istio-proxy" Jul 22 02:33:35.709829 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.709698 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37ca0fb7-1664-4396-a623-f6e655f17027" containerName="istio-proxy" Jul 22 02:33:35.712807 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.712791 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.715486 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.715466 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wdk\"/\"openshift-service-ca.crt\"" Jul 22 02:33:35.715648 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.715557 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-49wdk\"/\"default-dockercfg-fbnjc\"" Jul 22 02:33:35.716376 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.716357 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49wdk\"/\"kube-root-ca.crt\"" Jul 22 02:33:35.721906 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.721881 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz"] Jul 22 02:33:35.866453 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.866421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-proc\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.866640 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.866471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24dgm\" (UniqueName: \"kubernetes.io/projected/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-kube-api-access-24dgm\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.866640 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.866527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-podres\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.866640 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.866588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-sys\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.866746 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.866637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-lib-modules\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967345 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-sys\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967345 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967301 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-lib-modules\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967345 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-proc\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967369 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24dgm\" (UniqueName: \"kubernetes.io/projected/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-kube-api-access-24dgm\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967388 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-sys\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-podres\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967461 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-proc\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967469 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-podres\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.967609 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.967550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-lib-modules\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:35.977141 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:35.977117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24dgm\" (UniqueName: \"kubernetes.io/projected/3a56eb6b-86f2-4fd8-a56b-59bc2800152f-kube-api-access-24dgm\") pod \"perf-node-gather-daemonset-fvzkz\" (UID: \"3a56eb6b-86f2-4fd8-a56b-59bc2800152f\") " pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:36.023999 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:36.023964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:36.037074 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:36.037045 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-nw4sp_69fb37d7-eb51-4077-ac18-1472f0bf039d/networking-console-plugin/0.log" Jul 22 02:33:36.184829 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:36.184734 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz"] Jul 22 02:33:36.187210 ip-10-0-143-108 kubenswrapper[2554]: W0722 02:33:36.187183 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a56eb6b_86f2_4fd8_a56b_59bc2800152f.slice/crio-999497dfa32f6593a5d521b6c9cf7cfb0cdb336e28b28b9460f9b56848d60f4d WatchSource:0}: Error finding container 999497dfa32f6593a5d521b6c9cf7cfb0cdb336e28b28b9460f9b56848d60f4d: Status 404 returned error can't find the container with id 999497dfa32f6593a5d521b6c9cf7cfb0cdb336e28b28b9460f9b56848d60f4d Jul 22 02:33:36.206713 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:36.206682 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" event={"ID":"3a56eb6b-86f2-4fd8-a56b-59bc2800152f","Type":"ContainerStarted","Data":"999497dfa32f6593a5d521b6c9cf7cfb0cdb336e28b28b9460f9b56848d60f4d"} Jul 22 02:33:36.713213 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:36.713186 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/1.log" Jul 22 02:33:36.717120 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:36.717100 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-zq9wq_37952390-fa46-4a89-a529-cf9451d4b668/console-operator/2.log" Jul 22 02:33:37.212647 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:37.212610 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" event={"ID":"3a56eb6b-86f2-4fd8-a56b-59bc2800152f","Type":"ContainerStarted","Data":"901f93ecf2e87158ea5835ac3d305b3bf1ad63f377a5d5156f06923e0b43ca5d"} Jul 22 02:33:37.212837 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:37.212736 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:37.225857 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:37.225828 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-khlds_d4ed1df8-0add-436e-ac57-6548577d8824/download-server/0.log" Jul 22 02:33:37.232852 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:37.232808 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" podStartSLOduration=2.232792767 podStartE2EDuration="2.232792767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:33:37.230174825 +0000 UTC m=+2776.170142086" watchObservedRunningTime="2026-07-22 02:33:37.232792767 +0000 UTC m=+2776.172760060" Jul 22 02:33:37.859041 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:37.859010 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-hdkwk_8627ee41-9af2-4187-a91e-e853df0aafd2/volume-data-source-validator/0.log" Jul 22 02:33:39.207670 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:39.207643 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvcvb_ca86d95e-a805-450d-97f8-d4d7d3cfe66f/dns/0.log" Jul 22 02:33:39.246169 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:39.246143 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvcvb_ca86d95e-a805-450d-97f8-d4d7d3cfe66f/kube-rbac-proxy/0.log" Jul 22 02:33:39.485262 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:39.485171 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t7nlt_754f03ce-1f47-4f19-b188-e4f4c7f28d43/dns-node-resolver/0.log" Jul 22 02:33:40.178886 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:40.178855 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98ngj_8cbabdd9-b920-4219-ba7e-0656628d05d8/node-ca/0.log" Jul 22 02:33:41.447467 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:41.447441 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cgn2q_4322b333-4774-4d0a-900d-49555f2916be/istio-proxy/0.log" Jul 22 02:33:41.585379 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:41.585349 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t22gn_0ec17ba8-4a4d-47da-a57d-540962ada1d8/discovery/0.log" Jul 22 02:33:41.757359 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:41.757271 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tqmbd_742fb4d8-ced1-4e81-a4fe-af70acd8a987/payload-pre-processing/0.log" Jul 22 02:33:41.828145 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:41.828122 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fd7458cb-mzkb2_0893a9f4-2552-4b8e-af5a-2e43e0a24618/router/0.log" Jul 22 02:33:42.629978 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:42.629944 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lv5wf_4f222ec5-bcc6-404f-8400-1804dacd9332/serve-healthcheck-canary/0.log" Jul 22 02:33:43.228554 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:43.228522 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-49wdk/perf-node-gather-daemonset-fvzkz" Jul 22 02:33:43.312662 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:43.312632 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-q5h5g_cfcb9752-c785-43e1-ba5d-6328fd02dec9/insights-operator/0.log" Jul 22 02:33:43.313154 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:43.313138 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-q5h5g_cfcb9752-c785-43e1-ba5d-6328fd02dec9/insights-operator/1.log" Jul 22 02:33:43.341684 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:43.341658 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgtzd_66ee7c66-0d62-4b83-b770-4a584e1b972d/kube-rbac-proxy/0.log" Jul 22 02:33:43.369194 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:43.369168 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgtzd_66ee7c66-0d62-4b83-b770-4a584e1b972d/exporter/0.log" Jul 22 02:33:43.402302 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:43.402275 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgtzd_66ee7c66-0d62-4b83-b770-4a584e1b972d/extractor/0.log" Jul 22 02:33:45.858201 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:45.858168 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cgn2q_4322b333-4774-4d0a-900d-49555f2916be/istio-proxy/0.log" Jul 22 02:33:45.968591 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:45.968558 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t22gn_0ec17ba8-4a4d-47da-a57d-540962ada1d8/discovery/0.log" Jul 22 02:33:46.079165 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:46.079089 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tqmbd_742fb4d8-ced1-4e81-a4fe-af70acd8a987/payload-pre-processing/0.log" Jul 22 02:33:46.149042 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:46.148996 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fd7458cb-mzkb2_0893a9f4-2552-4b8e-af5a-2e43e0a24618/router/0.log" Jul 22 02:33:46.379440 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:46.379356 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7db775cb8b-4bxdn_1d2bc59d-fef7-4602-a6a1-fb19c382c20a/manager/0.log" Jul 22 02:33:46.522705 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:46.522676 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6w8qc_99bc3c58-35d8-44f7-99a5-c8d7add2e286/server/0.log" Jul 22 02:33:46.680339 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:46.680315 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-9bccm_7da8827e-d16d-447e-bec1-03cd59fffb2b/manager/0.log" Jul 22 02:33:46.725910 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:46.725881 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76db4bc599-9bccm_7da8827e-d16d-447e-bec1-03cd59fffb2b/copy-manifests/0.log" Jul 22 02:33:47.500746 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:47.500668 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4cgn2q_4322b333-4774-4d0a-900d-49555f2916be/istio-proxy/0.log" Jul 22 02:33:47.766172 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:47.766096 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t22gn_0ec17ba8-4a4d-47da-a57d-540962ada1d8/discovery/0.log" Jul 22 02:33:48.077935 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:48.077850 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tqmbd_742fb4d8-ced1-4e81-a4fe-af70acd8a987/payload-pre-processing/0.log" Jul 22 02:33:48.143216 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:48.143180 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fd7458cb-mzkb2_0893a9f4-2552-4b8e-af5a-2e43e0a24618/router/0.log" Jul 22 02:33:48.634895 ip-10-0-143-108 kubenswrapper[2554]: I0722 02:33:48.634864 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54d5765bf5-7kgl7_2b0cc1cf-da74-484b-bd3d-714ace87398e/manager/0.log"